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Preface 


This is a text for a two-term course in introductory real analysis for junior or senior math- 
ematics majors and science students with a serious interest in mathematics. Prospective 
educators or mathematically gifted high school students can also benefit from the mathe- 
matical maturity that can be gained from an introductory real analysis course. 


The book is designed to fill the gaps left in the development of calculus as it is usually 
presented in an elementary course, and to provide the background required for insight into 
more advanced courses in pure and applied mathematics. The standard elementary calcu- 
lus sequence is the only specific prerequisite for Chapters 1—5, which deal with real-valued 
functions. (However, other analysis oriented courses, such as elementary differential equa- 
tion, also provide useful preparatory experience.) Chapters 6 and 7 require a working 
knowledge of determinants, matrices and linear transformations, typically available from a 
first course in linear algebra. Chapter 8 is accessible after completion of Chapters 1—5. 


Without taking a position for or against the current reforms in mathematics teaching, I 
think it is fair to say that the transition from elementary courses such as calculus, linear 
algebra, and differential equations to a rigorous real analysis course is a bigger step to- 
day than it was just a few years ago. To make this step today’s students need more help 
than their predecessors did, and must be coached and encouraged more. Therefore, while 
striving throughout to maintain a high level of rigor, I have tried to write as clearly and in- 
formally as possible. In this connection I find it useful to address the student in the second 
person. I have included 295 completely worked out examples to illustrate and clarify all 
major theorems and definitions. 


I have emphasized careful statements of definitions and theorems and have tried to be 
complete and detailed in proofs, except for omissions left to exercises. I give a thorough 
treatment of real-valued functions before considering vector-valued functions. In making 
the transition from one to several variables and from real-valued to vector-valued functions, 
I have left to the student some proofs that are essentially repetitions of earlier theorems. I 
believe that working through the details of straightforward generalizations of more elemen- 
tary results is good practice for the student. 


Great care has gone into the preparation of the 761 numbered exercises, many with 
multiple parts. They range from routine to very difficult. Hints are provided for the more 
difficult parts of the exercises. 


vi 


Preface vii 
Organization 


Chapter 1 is concerned with the real number system. Section 1.1 begins with a brief dis- 
cussion of the axioms for a complete ordered field, but no attempt is made to develop the 
reals from them; rather, it is assumed that the student is familiar with the consequences of 
these axioms, except for one: completeness. Since the difference between a rigorous and 
nonrigorous treatment of calculus can be described largely in terms of the attitude taken 
toward completeness, I have devoted considerable effort to developing its consequences. 
Section 1.2 is about induction. Although this may seem out of place in a real analysis 
course, I have found that the typical beginning real analysis student simply cannot do an 
induction proof without reviewing the method. Section 1.3 is devoted to elementary set the- 
ory and the topology of the real line, ending with the Heine-Borel and Bolzano-Weierstrass 
theorems. 


Chapter 2 covers the differential calculus of functions of one variable: limits, continu- 
ity, differentiablility, L' Hospital's rule, and Taylor's theorem. The emphasis is on rigorous 
presentation of principles; no attempt is made to develop the properties of specific ele- 
mentary functions. Even though this may not be done rigorously in most contemporary 
calculus courses, I believe that the student's time is better spent on principles rather than 
on reestablishing familiar formulas and relationships. 


Chapter 3 is to devoted to the Riemann integral of functions of one variable. In Sec- 
tion 3.1 the integral is defined in the standard way in terms of Riemann sums. Upper and 
lower integrals are also defined there and used in Section 3.2 to study the existence of the 
integral. Section 3.3 is devoted to properties of the integral. Improper integrals are studied 
in Section 3.4. I believe that my treatment of improper integrals is more detailed than in 
most comparable textbooks. A more advanced look at the existence of the proper Riemann 
integral is given in Section 3.5, which concludes with Lebesgue's existence criterion. This 
section can be omitted without compromising the student's preparedness for subsequent 
sections. 


Chapter 4 treats sequences and series. Sequences of constant are discussed in Sec- 
tion 4.1. I have chosen to make the concepts of limit inferior and limit superior parts 
of this development, mainly because this permits greater flexibility and generality, with 
little extra effort, in the study of infinite series. Section 4.2 provides a brief introduction 
to the way in which continuity and differentiability can be studied by means of sequences. 
Sections 4.3—4.5 treat infinite series of constant, sequences and infinite series of functions, 
and power series, again in greater detail than in most comparable textbooks. The instruc- 
tor who chooses not to cover these sections completely can omit the less standard topics 
without loss in subsequent sections. 


Chapter 5 is devoted to real-valued functions of several variables. It begins with a dis- 
cussion of the toplogy of IR" in Section 5.1. Continuity and differentiability are discussed 
in Sections 5.2 and 5.3. The chain rule and Taylor's theorem are discussed in Section 5.4. 


viii Preface 


Chapter 6 covers the differential calculus of vector-valued functions of several variables. 
Section 6.1 reviews matrices, determinants, and linear transformations, which are integral 
parts of the differential calculus as presented here. In Section 6.2 the differential of a 
vector-valued function is defined as a linear transformation, and the chain rule is discussed 
in terms of composition of such functions. The inverse function theorem is the subject of 
Section 6.3, where the notion of branches of an inverse is introduced. In Section 6.4. the 
implicit function theorem is motivated by first considering linear transformations and then 
stated and proved in general. 


Chapter 7 covers the integral calculus of real-valued functions of several variables. Mul- 
tiple integrals are defined in Section 7.1, first over rectangular parallelepipeds and then 
over more general sets. The discussion deals with the multiple integral of a function whose 
discontinuities form a set of Jordan content zero. Section 7.2 deals with the evaluation by 
iterated integrals. Section 7.3 begins with the definition of Jordan measurability, followed 
by a derivation of the rule for change of content under a linear transformation, an intuitive 
formulation of the rule for change of variables in multiple integrals, and finally a careful 
statement and proof of the rule. The proof is complicated, but this is unavoidable. 


Chapter 8 deals with metric spaces. The concept and properties of a metric space are 
introduced in Section 8.1. Section 8.2 discusses compactness in a metric space, and Sec- 
tion 8.3 discusses continuous functions on metric spaces. 


Corrections—mathematical and typographical—are welcome and will be incorporated when 
received. 


William F. Trench 

wtrench @trinity.edu 

Home: 659 Hopkinton Road 
Hopkinton, NH 03229 


CHAPTER 1 


The Real Numbers 


IN THIS CHAPTER we begin the study of the real number system. The concepts discussed 
here will be used throughout the book. 


SECTION 1.1 deals with the axioms that define the real numbers, definitions based on 
them, and some basic properties that follow from them. 


SECTION 1.2 emphasizes the principle of mathematical induction. 


SECTION 1.3 introduces basic ideas of set theory in the context of sets of real num- 
bers. In this section we prove two fundamental theorems: the Heine-Borel and Bolzano- 
Weierstrass theorems. 


1.1 THE REAL NUMBER SYSTEM 


Having taken calculus, you know a lot about the real number system; however, you prob- 
ably do not know that all its properties follow from a few basic ones. Although we will 
not carry out the development of the real number system from these basic properties, it is 
useful to state them as a starting point for the study of real analysis and also to focus on 
one property, completeness, that is probably new to you. 


Field Properties 


The real number system (which we will often call simply the reals) is first of all a set 
{a,b,c,...} on which the operations of addition and multiplication are defined so that 
every pair of real numbers has a unique sum and product, both real numbers, with the 
following properties. 


(A) a+b=b+aandab = ba (commutative laws). 

(B) @+b)+c=a+(b + с) and (ab)c = a(bc) (associative laws). 

(C) a(b-c)- ab + ac (distributive law). 

(D) There are distinct real numbers 0 and 1 such that a + 0 = a and al =a for all a. 


(E) For each a there is a real number —a such that a + (—a) = 0, and if a Æ 0, there is 
a real number 1/a such that a(1/a) — 1. 
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The manipulative properties of the real numbers, such as the relations 
(a + b)? =a? + 2ab + Ь?, 
(За + 2b)(4c + 2d) = 12ac + баа + 8bc + 4bd, 
(—а) =(-l)a, a(—b) = (—a)b = —ab, 


and 
та к. 
b d bd 


all follow from (A)-(E). We assume that you are familiar with these properties. 


(b. d #0), 


A set on which two operations are defined so as to have properties (A)-(E) is called a 
field. The real number system is by no means the only field. The rational numbers (which 
are the real numbers that can be written as r = p/q, where p and q are integers and 4 # 0) 
also form a field under addition and multiplication. The simplest possible field consists of 
two elements, which we denote by 0 and 1, with addition defined by 


0+0=1+1=0, 14+0=041=1, (1.1.1) 
and multiplication defined by 
0-0=0-1=1-0=0, 1-l=1 (1.1.2) 
(Exercise 1.1.2). 


The Order Relation 


The real number system is ordered by the relation <, which has the following properties. 


(F) For each pair of real numbers a and b, exactly one of the following is true: 


a=b, a«b, or b«a. 


(G) Ifa « b and b < с, thena < c. (The relation < is transitive.) 
(Н) Ifa < b, thena +c <b + c forany c, and if 0 < c, then ac < bc. 

A field with an order relation satisfying (Е)-(Н) is an ordered field. Thus, the real 
numbers form an ordered field. The rational numbers also form an ordered field, but it is 


impossible to define an order on the field with two elements defined by (1.1.1) and (1.1.2) 
so as to make it into an ordered field (Exercise 1.1.2). 


We assume that you are familiar with other standard notation connected with the order 
relation: thus, a > b means that b < a; a > b means that either a = bora > b;a < b 
means that either a = b ora < b; the absolute value of a, denoted by |a|, equals a if 
a > 0 or —a if a < 0. (Sometimes we call |а| the magnitude of a.) 

You probably know the following theorem from calculus, but we include the proof for 
your convenience. 
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Theorem 1.1.1 (The Triangle Inequality) Ifa and b are any two real numbers, 
then 
la + b| < |a] + |bl. (1.1.3) 


Proof There are four possibilities: 

(a) Ifa > O and b > 0, thena +b > 0, ѕо |а -- b| = a +b = |а| + |0. 

(b) Ifa < 0 and b < 0, thena + b < 0, so |a + b| = —a + (—b) = |a| + |b]. 
(c) Ifa > Oand b <0, thena +b = |а| — |b]. 

(d) Ifa < 0 and b > 0, thena + b = —|a| + |b]. 

Eq. 1.1.3 holds in cases (c) and (d), since 


la| —|b] if lal > |b], 
la+bl= f ш 
Ib| 1а] if |b] > la]. 


The triangle inequality appears in various forms in many contexts. It is the most impor- 
tant inequality in mathematics. We will use it often. 


Corollary 1.1.2 [fa and b are any two real numbers, then 
la — b| > |la| —|b|| (1.1.4) 


and 


la + b| > |la| — 1511. (1.1.5) 
Proof Replacing a by a — b in (1.1.3) yields 
a| x |a — b| + |b], 


so 
a— b| > |а| — |b|. (1.1.6) 


Interchanging a and b here yields 


which is equivalent to 


a — b| > |b| — |а|, (1.1.7) 
since |b — a| = |a — b|. Since 
la|- |b| if |a| > |01. 
|lal — Ibl] = | 
Ib| —la| if |b| > la], 


(1.1.6) and (1.1.7) imply (1.1.4). Replacing b by —b in (1.1.4) yields (1.1.5), since | - b| = 
|^]. BH Supremum of a Set 


A set S of real numbers is bounded above if there is a real number b such that x < b 
whenever x € 5. In this case, b is an upper bound of S. If b is an upper bound of S, 
then so is any larger number, because of property (С). If В is an upper bound of S, but no 
number less than £ is, then f is a supremum of S , and we write 


В = sup S. 
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With the real numbers associated in the usual way with the points on a line, these defini- 
tions can be interpreted geometrically as follows: b is an upper bound of 5 if no point of 5 
is to the right of b; В = sup S if no point of 5 is to the right of В, but there is at least one 
point of S to the right of any number less than В (Figure 1.1.1). 


(S = dark line segments) 


Figure 1.1.1 


Example 1.1.1 If S is the set of negative numbers, then any nonnegative number is an 
upper bound of S, and sup 5 = 0. If S, is the set of negative integers, then any number a 
such that a > —1 is an upper bound of S1, and sup S, = — 1. E 


This example shows that a supremum of a set may or may not be in the set, since 51 
contains its supremum, but 5 does not. 


A nonempty set is a set that has at least one member. The empty set, denoted by Ø, is the 
set that has no members. Although it may seem foolish to speak of such a set, we will see 
that it is a useful idea. 


The Completeness Axiom 


It is one thing to define an object and another to show that there really is an object that 
satisfies the definition. (For example, does it make sense to define the smallest positive 
real number?) This observation is particularly appropriate in connection with the definition 
of the supremum of a set. For example, the empty set is bounded above by every real 
number, so it has no supremum. (Think about this.) More importantly, we will see in 
Example 1.1.2 that properties (A)-(H) do not guarantee that every nonempty set that 
is bounded above has a supremum. Since this property is indispensable to the rigorous 
development of calculus, we take it as an axiom for the real numbers. 
(I) Ifa nonempty set of real numbers is bounded above, then it has a supremum. 
Property (Т) is called completeness, and we say that the real number system is a complete 
ordered field. It can be shown that the real number system is essentially the only complete 
ordered field; that is, if an alien from another planet were to construct a mathematical 
system with properties (A)-(I), the alien's system would differ from the real number 
system only in that the alien might use different symbols for the real numbers and +, ·, 
and «. 


Theorem 1.1.3 Ifa nonempty set S of real numbers is bounded above, then sup S is 
the unique real number B such that 


(a) x < for all x in S; 


(b) ife > 0 (no matter how small), there is an xo in S such that xo > B — є. 
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Proof We first show that В = sup S has properties (a) and (b). Since f is an upper 
bound of S, it must satisfy (a). Since any real number a less than В can be written as f — € 
with e = f — a > 0, (b) is just another way of saying that no number less than f is ап 
upper bound of $. Hence, f = sup S satisfies (a) and (b). 

Now we show that there cannot be more than one real number with properties (a) and 
(b). Suppose that В, < f; and f; has property (b); thus, if € > 0, there is an xo in S 
such that xo > Вг — є. Then, by taking € = 2 — В1, we see that there is an xo in S such 
that 


Xo > Bo — (B2 — Bi) = Bi. 
so Ву cannot have property (a). Therefore, there cannot be more than one real number 
that satisfies both (a) and (b). P. 


Some Notation 


We will often define a set S by writing S = {x | e) which means that S consists of all 
x that satisfy the conditions to the right of the vertical bar; thus, in Example 1.1.1, 


S = {x |x <0} (1.1.8) 
and 
51 = {x | x is a negative integer} Р 


We will sometimes abbreviate “х is a member of S” by x є S, and “х is not a member of 
S" by x € S. For example, if S is defined by (1.1.8), then 


-leS but 0#5. 


The Archimedean Property 


The property of the real numbers described in the next theorem is called the Archimedean 
property. Intuitively, it states that it is possible to exceed any positive number, no matter 
how large, by adding an arbitrary positive number, no matter how small, to itself sufficiently 
many times. 


Theorem 1.1.4 (Archimedean Property) /f p and є are positive, then ne > 
p for some integer n. 


Proof The proof is by contradiction. If the statement is false, p is an upper bound of 
the set 
5 = {х | x — ne,nisan integer] . 


Therefore, S has a supremum £, by property (I). Therefore, 


ne < В forall integers n. (1.1.9) 
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Since n + 1 is an integer whenever n is, (1.1.9) implies that 
(п + Dez 
and therefore 
ne < В є 


for all integers n. Hence, В — є is an upper bound of S. Since В — є < В, this contradicts 
the definition of В. a 


Density of the Rationals and Irrationals 


Definition 1.1.5 A set D is dense in the reals if every open interval (a, b) contains a 
member of D. 


Theorem 1.1.6 The rational numbers are dense in the reals; that is, if a and b are 
real numbers with a < b, there is a rational number p/q such thata < p/q < b. 


Proof From Theorem 1.1.4 with р = 1 and e = b — a, there is a positive integer q such 
that q(b — a) > 1. There is also an integer j such that j > qa. This is obvious if a < 0, 
and it follows from Theorem 1.1.4 with e = 1 and p = qa if a > 0. Let p be the smallest 
integer such that p > qa. Then p — 1 < qa, so 


qa « p € qa +1. 
Since 1 « q(b — a), this implies that 
qa < p < qa t q(b — a) = qb, 
so qa « p « qb. Therefore, a « p/q « b. ш 


Example 1.1.2 The rational number system is not complete; that is, a set of rational 
numbers may be bounded above (by rationals), but not have a rational upper bound less 
than any other rational upper bound. To see this, let 


S= {r | r is rational and r? < 2) : 


Ifr e S, thenr « A/2. Theorem 1.1.6 implies that if € > 0 there is a rational number ro 
such that /2—€ < ro < 4/2, so Theorem 1.1.3 implies that 4/2 = sup S. However, 4/2 is 
irrational; that is, it cannot be written as the ratio of integers (Exercise 1.1.3). Therefore, 
if rı is any rational upper bound of S, then 4/2 < г. By Theorem 1.1.6, there is a rational 
number rz such that V2 < r2 < гү. Since rz is also a rational upper bound of S, this shows 
that S has no rational supremum. " 


Since the rational numbers have properties (A.)—(H), but not (I), this example shows 
that (Т) does not follow from (A)-(H). 


Theorem 1.1.7 The set of irrational numbers is dense in the reals; that is, if a and b 
are real numbers with a < b, there is an irrational number t such that a < t < b. 
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Proof From Theorem 1.1.6, there are rational numbers rı and r2 such that 


a «ri < ғ «b. (1.1.10) 
Let | 
peg WS — гу). 
Then t is irrational (why?) and r4 < / < r2, soa < t < b, from (1.1.10). E 


Infimum of a Set 


A set S of real numbers is bounded below if there is a real number a such that x > a 
whenever x € S. In this case, a is a lower bound of S. If a is a lower bound of S, so is 
any smaller number, because of property (G). If œ is a lower bound of S, but no number 
greater than o is, then o is an infimum of S, and we write 


a = inf S. 


Geometrically, this means that there are no points of S to the left of œ, but there is at least 
one point of S to the left of any number greater than o. 


Theorem 1.1.8 Ifa nonempty set S of real numbers is bounded below, then inf S is 
the unique real number a such that 


(a) x xa forall x in S; 
(b) ife > 0 (no matter how small), there is an xo in S such that xo < ot + є. 


Proof (Exercise 1.1.6) 


A set S is bounded if there are numbers a and b such that a < x < b for all x in S.A 
bounded nonempty set has a unique supremum and a unique infimum, and 


inf 5 < sup 5 (1.1.11) 
(Exercise 1.1.7). E 


The Extended Real Number System 


A nonempty set S of real numbers is unbounded above if it has no upper bound, or un- 
bounded below if it has no lower bound. It is convenient to adjoin to the real number 
system two fictitious points, +00 (which we usually write more simply as оо) and —oo, 
and to define the order relationships between them and any real number x by 


-œ <x «oo. (1.1.12) 
We call оо and —oo points at infinity. If S is a nonempty set of reals, we write 
sup S = oo (1.1.13) 
to indicate that S is unbounded above, and 
inf S = —oo (1.1.14) 


to indicate that S is unbounded below. 


8 Chapter 1 The Real Numbers 


Example 1.1.3 If 
S = {х | x < 21, 


then sup 5 = 2 and inf S = —oo. If 
S= {x [x >—2}, 


then sup 5 = oo and inf S = —2. If S is the set of all integers, then sup 5 = оо and 
inf S = —oo. a 


The real number system with oo and —oo adjoined is called the extended real number 
system, or simply the extended reals. A member of the extended reals differing from —oo 
and oo is finite; that is, an ordinary real number is finite. However, the word "finite" in 
"finite real number" is redundant and used only for emphasis, since we would never refer 
to оо or —oo as real numbers. 


The arithmetic relationships among oo, —oo, and the real numbers are defined as follows. 


(a) Ifa is any real number, then 


а+осо= оо +а= о, 
а — œ = —œ + а = —oo, 
а а 
— = — = 0 
œo  —oo 
(b) Ifa > 0, then 
асо = ooa = oo, 
а (—oo) = (—00) a = —oo. 
(c) Ifa < 0, then 
ao = wa = oo, 
а (оо) = (-o0)a = oo. 
We also define 
оо + œ = œ% = (—оо)(—оо) = оо 
and 
—00 — oo = oo(—oo) = (—o0)oo = —oo. 
Finally, we define 
[œ| = | — œ| = оо. 


The introduction of co and —oo, along with the arithmetic and order relationships defined 
above, leads to simplifications in the statements of theorems. For example, the inequality 
(1.1.11), first stated only for bounded sets, holds for any nonempty set S if itis interpreted 
properly in accordance with (1.1.12) and the definitions of (1.1.13) and (1.1.14). Exer- 
cises 1.1.10(b) and 1.1.11(b) illustrate the convenience afforded by some of the arith- 
metic relationships with extended reals, and other examples will illustrate this further in 
subsequent sections. 
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It is not useful to define oo — oo, 0- oo, оо/оо, and 0/0. They are called indeterminate 
forms, and left undefined. You probably studied indeterminate forms in calculus; we will 
look at them more carefully in Section 2.4. 


1.1 Exercises 


1. Write the following expressions in equivalent forms not involving absolute values. 
(a) a 4- b + |a — b| (b) a +b- |a — b| 
(c) a - b - 2c t |a — b| + |a b —2c 4+ |a — b|| 
(d) a +b - 2c - |a - b| - |a b - 2c — |a — b|| 

2. Verify that the set consisting of two members, 0 and 1, with operations defined by 


Eqns. (1.1.1) and (1.1.2), is a field. Then show that itis impossible to define an order 
< on this field that has properties (F), (G), and (Н). 


3. Show that 4/2 is irrational. HINT: Show that if /2 = m/n, where m and n are 
integers, then both m and n must be even. Obtain a contradiction from this. 
Show that 4/p is irrational if p is prime. 
5.  Findthe supremum and infimum of each S. State whether they are in S. 
(а) S = {x|x 2-/n) + [1 + (-1)"]n?,n = 1) 
(b) S={x|x? « 9) 
(c) $={х|х®^<7} 
(d S = {x||2x+1|<5} 
(е) 5 = {х (х2 +D > 1 
(f) S = (x |х = rational and x? < 7} 
6. Prove Theorem 1.1.8. HINT: The set Т = {x | -x€ S} is bounded above if S is 
bounded below. Apply property (1) and Theorem 1.1.3 to T. 
7. (a) Show that 


inf S < sup S (A) 


for any nonempty set S of real numbers, and give necessary and sufficient 
conditions for equality. 

(b) Show that if S is unbounded then (A) holds if it is interpreted according to 
Eqn. (1.1.12) and the definitions of Eqns. (1.1.13) and (1.1.14). 


8. Let S and T be nonempty sets of real numbers such that every real number is in S 
or T and if s € S and t € T, then s < t. Prove that there is a unique real number f 
such that every real number less than 6 is in S and every real number greater than 
P is in T. (A decomposition of the reals into two sets with these properties is a 
Dedekind cut. This is known as Dedekind's theorem.) 
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9. 


10. 


11. 


12. 


Using properties (A)-(H) of the real numbers and taking Dedekind’s theorem 
(Exercise 1.1.8) as given, show that every nonempty set U of real numbers that is 
bounded above has a supremum. HINT: Let T be the set of upper bounds of U and 
S be the set of real numbers that are not upper bounds of U. 


Let S and T' be nonempty sets of real numbers and define 
S+T={s+t|seS,teT}. 
(a) Show that 


sup(S + T) = sup 5 + sup T (A) 
if S and T are bounded above and 
inf(S + T) = inf S + inf T (B) 


if S and Т are bounded below. 
(b) Show that if they are properly interpreted in the extended reals, then (A) and 
(B) hold if S and Т are arbitrary nonempty sets of real numbers. 


Let S and T be nonempty sets of real numbers and define 
S-T={s-t|seS,teT}. 
(a) Show that if S and T are bounded, then 
sup(S — T) = sup S — inf T (A) 
and 
inf(S — Т) = inf S — sup T. (B) 


(b) Show that if they are properly interpreted in the extended reals, then (A) and 
(B) hold if S and Т are arbitrary nonempty sets of real numbers. 


Let S be a bounded nonempty set of real numbers, and let a and b be fixed real 
numbers. Define T = {as +b | ses | Find formulas for sup Т and inf T in terms 
of sup S and inf S. Prove your formulas. 


1.2 MATHEMATICAL INDUCTION 


If a flight of stairs is designed so that falling off any step inevitably leads to falling off the 
next, then falling off the first step is a sure way to end up at the bottom. Crudely expressed, 
this is the essence of the principle of mathematical induction: If the truth of a statement 
depending on a given integer n implies the truth of the corresponding statement with n 
replaced by n + 1, then the statement is true for all positive integers n if itis true for n = 1. 
Although you have probably studied this principle before, it is so important that it merits 
careful review here. 


Peano's Postulates and Induction 


The rigorous construction of the real number system starts with a set N of undefined ele- 
ments called natural numbers, with the following properties. 
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(A) Nis nonempty. 

(B) Associated with each natural number n there is a unique natural number n’ called 
the successor of n. 

(C) There is a natural number 7 that is not the successor of any natural number. 

(D) Distinct natural numbers have distinct successors; that is, if n 5 m, then n' 5 m. 


(E) The only subset of N that contains 7 and the successors of all its elements is N 
itself. 

These axioms are known as Peano's postulates. The real numbers can be constructed 
from the natural numbers by definitions and arguments based on them. This is a formidable 
task that we will not undertake. We mention it to show how little you need to start with to 
construct the reals and, more important, to draw attention to postulate (Е), which is the 
basis for the principle of mathematical induction. 

It can be shown that the positive integers form a subset of the reals that satisfies Peano’s 
postulates (with 7 = 1 and n’ = n + 1), and it is customary to regard the positive integers 
and the natural numbers as identical. From this point of view, the principle of mathematical 
induction is basically a restatement of postulate (E). 


Theorem 1.2.1 (Principle of Mathematical Induction) Let Pi, P»...., 
Py, ... be propositions, one for each positive integer, such that 


(a) Pi is true; 
(b) for each positive integer n, P, implies Pj 44. 
Then P, is true for each positive integer n. 
Proof Let 
M = In [п € Nand P, is true] . 
From (a), 1 € M, and from (b), n + 1 € M whenever n € M. Therefore, М = N, by 
postulate (E). п 
Example 1.2.1 Let Р„ be the proposition that 
n(n + 1) 
5 ~ 


Then P, is the proposition that 1 = 1, which is certainly true. If P, is true, then adding 
n 4- 1 to both sides of (1.2.1) yields 


14245424 = (1.2.1) 


n(n + 1) 
2 

= +1)(у+1) 

_ (n DG 2) 
—— 


(4+24+--4+n4+@4+)= +(n+1) 


or 
(1 + 1)(й + 2) 


1424+--4(@+)D= 2 
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which is P,+1, since it has the form of (1.2.1), with n replaced by n + 1. Hence, P, implies 
Py41, so (1.2.1) is true for all n, by Theorem 1.2.1. ш 


A proof based on Theorem 1.2.1 is an induction proof, or proof by induction. The 
assumption that P, is true is the induction assumption. (Theorem 1.2.3 permits a kind of 
induction proof in which the induction assumption takes a different form.) 


Induction, by definition, can be used only to verify results conjectured by other means. 
Thus, in Example 1.2.1 we did not use induction to find the sum 


8а = 1+2 +: +0; (1.2.2) 
rather, we verified that 
1 
T mr) (1.2.3) 


How you guess what to prove by induction depends on the problem and your approach to 
it. For example, (1.2.3) might be conjectured after observing that 


1-2 2.3 4-3 
меге мезе 53 = 6 = ——. 


However, this requires sufficient insight to recognize that these results are of the form 
(1.2.3) for n = 1, 2, and 3. Although it is easy to prove (1.2.3) by induction once it has 
been conjectured, induction is not the most efficient way to find s,, which can be obtained 
quickly by rewriting (1.2.2) as 


Sp =nt+(n—1)4+---4+1 
and adding this to (1.2.2) to obtain 
2s, = [n+ 1] - [a 1) - 2] ++ П + n]. 


There are n bracketed expressions on the right, and the terms in each add up ton + 1; 
hence, 

25, = n(n + 1), 
which yields (1.2.3). 


The next two examples deal with problems for which induction is a natural and efficient 
method of solution. 


Example 1.2.2 Let a; = 1 and 


1 


— an, > 1 1.2.4 
ЖОГУ ш. n= ( ) 


an+1 = 
(we say that а» is defined inductively), and suppose that we wish to find an explicit formula 
for a4. By considering n — 1, 2, and 3, we find that 
1 1 


, and аз= А 
1-2 1-2-3 


1 
aqj=-, аә = 
1 1 2 
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and therefore we conjecture that 
1 


an = —. (1.2.5) 
n! 
This is given for n = 1. If we assume it is true for some n, substituting it into (1.2.4) yields 
1 1 1 


апы = ——— = ——_, 
каат (n + 1)! 


which is (1.2.5) with n replaced by n + 1. Therefore, (1.2.5) is true for every positive 
integer 7, by Theorem 1.2.1. 


Example 1.2.3 For each nonnegative integer n, let x, be a real number and suppose 
that 
Xn+1 — Xn| < ааа, n21, (1.2.6) 


where r is a fixed positive number. By considering (1.2.6) for n = 1, 2, and 3, we find that 
x2 — Х| < "|х — xol, 


x3 — X2| < r|x2 — xi| < r?|x1 — xol, 
X4—xa| € r|x3 = x2| < |а — xo]. 


Therefore, we conjecture that 
li dealer xax if n21. (1.2.7) 
This is trivial for = 1. If itis true for some n, then (1.2.6) and (1.2.7) imply that 
хан — Хп] < rr" xi — xol. so |Xn+1 — xal < r”|xı — xol, 


which is proposition (1.2.7) with n replaced by n + 1. Hence, (1.2.7) is true for every 
positive integer n, by Theorem 1.2.1. ш 


The major effort in an induction proof (after P1, P2,..., Р„,... have been formulated) 
is usually directed toward showing that Р, implies Р, +1. However, it is important to verify 
Ру, since Р, may imply Р, + even if some or all of the propositions P1, P2, ..., Pn, ... 
are false. 


Example 1.2.4 Let P, be the proposition that 2n — 1 is divisible by 2. If P, is true 
then P, is also, since 
2n+1=(Qn—1)+4+2. 


However, we cannot conclude that P; is true form > 1. In fact, P, is false for every n. Ni 


The following formulation of the principle of mathematical induction permits us to start 
induction proofs with an arbitrary integer, rather than 1, as required in Theorem 1.2.1. 
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Theorem 1.2.2 Let по be any integer (positive, negative, or zero). Let Pag, Pno+1, 
.., Pn, ... be propositions, опе for each integer n > no, such that 


(a) Pno is true ; 

(b) for each integer n > no, P, implies Ръ+1. 

Then P, is true for every integer n > по. 

Proof Form > 1, let Qm be the proposition defined by Qm = Pm+no—1- Then Q1 = 
Pno is true by (a). If m > 1 and Qm = Pm+no—1 is true, then Qm+1 = Pm+no is true by 
(b) with л replaced by m + no — 1. Therefore, Qm is true for all т > 1 by Theorem 1.2.1 


with P replaced by О and n replaced by m. This is equivalent to the statement that P; is 
true for all n > ng. ш 


Example 1.2.5 Consider the proposition Р, that 
Зп + 16 > 0. 
If Р, is true, then so is Py+1, since 
3(n +1) + 16 2 3n+3+ 16 


= (3n + 16) 4- 3 > 0 4- 3 (by the induction assumption) 
> 0. 


The smallest no for which Py, is true is по = —5. Hence, Py is true for n > —5, by 
Theorem 1.2.2. 


Example 1.2.6 Let P, be the proposition that 
n! — 3" > 0. 
If P, is true, then 
(n 4-1) —3"*! = nt(n + 1)—3"*! 

> 3"(n + 1) —3"*! (by the induction assumption) 

= 3" (n — 2). 
Therefore, P, implies P4..1 if n > 2. By trial and error, по = 7 is the smallest integer 
such that Pj, is true; hence, P; is true for n > 7, by Theorem 1.2.2. ш 


The next theorem is a useful consequence of the principle of mathematical induction. 


Theorem 1.2.3 Letno be any integer (positive, negative, or zero). Let Png, Pno+1.+-> 
Pa, ... be propositions, one for each integer n > no, such that 


(a) Pno is true ; 
(b) for n = no, Phot is true if Pao, Pno+1,---, Pn are all true. 


Then P, is true for n = no. 


Section 1.2 Mathematical Induction 15 


Proof Forn > no, let Qn be the proposition that Pno» Pno+1>--+» Pn are all true. Then 
Qno is true by (a). Since Qn implies Py+1 by (b), and Qn+1 is true if Qn and Р„+ are 
both true, Theorem 1.2.2 implies that О, is true for all n > по. Therefore, P, is true for 
all n > no. ш 


Example 1.2.7 An integer p > 1 is a prime if it cannot be factored as р = rs where 
r and s are integers and 1 < r,s < p. Thus, 2, 3, 5, 7, and 11 are primes, and, although 4, 
6, 8, 9, and 10 are not, they are products of primes: 


4—2.2, 62.3, 8—2.2.2, 9= 3.3, 10= 2.5. 


These observations suggest that each integer n > 2 is a prime or a product of primes. Let 
this proposition be Pa. Then Р» is true, but neither Theorem 1.2.1 nor Theorem 1.2.2 
apply, since Р, does not imply P,+1 in any obvious way. (For example, it is not evident 
from 24 = 2 -2 -2 · 3 that 25 is a product of primes.) However, Theorem 1.2.3 yields the 
stated result, as follows. Suppose that п > 2 and P5, ..., P, are true. Either n + lisa 
prime or 

n+l=rs, (1.2.8) 
where r and s are integers and 1 < r,s < n, so P, and P; are true by assumption. Hence, r 
and s are primes or products of primes and (1.2.8) implies that п + 1 is a product of primes. 


We have now proved Р, + (that п + 1 is a prime or a product of primes). Therefore, P, is 
true for all п > 2, by Theorem 1.2.3. 


1.2 Exercises 


Prove the assertions in Exercises 1.2.1—1.2.6 by induction. 


1. The sum of the first п odd integers is n?. 


1)(2 1 
2. ГТКК РОТ OE Ded). 


6 
4n? —] 
12 +32 +... + @n- 1}? = сы 
4. Таџ, аз,..., ап are arbitrary real numbers, then 


lay +a2 +--+ а, | € |а1| + |а| +--+ + lanl. 
5. Ifa; >0,i > 1, then 
(1 + a1)(1 + a2)--- + Gn) = 1 +а a2 c o an. 
6. If0<a; <1,i > 1,then 


(1 — a)(1 — a2): (1 аһ) 1—41 —2-+-— аһ. 
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10. 


11. 


12. 


13. 


14. 


Suppose that so > О and s, = 1 — e ?"-1, n > 1. Show that O < s, < 1,7 > 1. 


Suppose that R > 0, xo > 0, and 


iz») 
Xn (Бх |, n=O. 
2\ Xn 


Prove: For n > 1, Xn > Xn+1 > У R and 


хп — Rx (xo — VR? 


1 
c9" Xo 


Find and prove by induction an explicit formula for an if a; = 1 and, forn > 1, 


аһ Зап 
(A) axis (п + D)n + 0) pases (2n + 2)(2n + 3) 
2n 41 ry" 
(c) аһ+1 = FOU (d) an+1 = (1 + ~) an 


Let ay = 0 and an+ı = (n + 1)a, forn > 1, and let P, be the proposition that 
an =n! 

(a) Show that Р, implies Р, +1. 

(b) Is there an integer n for which P is true? 


Let P, be the proposition that 


(n 4- 2)(n — 1) 


1+2+--+n= 
2 


(a) Show that Р, implies Р, +1. 
(b) Is there an integer n for which P is true? 


For what integers n is 
1 8" 


— > —? 
n! (2n)! 
Prove your answer by induction. 
Let a be an integer > 2. 
(a) Show by induction that if n is a nonnegative integer, then n = aq + r, where 
q (quotient) and r (remainder) are integers and 0 < r < a. 
(b) Show that the result of (a) is true if n is an arbitrary integer (not necessarily 
nonnegative). 
(c) Show that there is only one way to write a given integer in the formn = 
aq + т, where q andr are integers and 0 <r <a. 


Take the following statement as given: If p is a prime and a and b are integers such 
that p divides the product ab, then p divides a or b. 


15. 


16. 


17. 


18. 


19. 
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(a) Prove: If p, pi,..., рк are positive primes and p divides the product p; ··· рк, 
then p = pi for some i in {1,..., k}. 
(b) Letn be an integer > 1. Show that the prime factorization of n found in 
Example 1.2.7 is unique in the following sense: If 
n = pi: pr and n = qdiq2***qds, 


where pi, ..., pr. q1, ---, qs are positive primes, then r = s and {q1,..., qr} 
is a permutation of {p1,..., р}. 


Let ay = аә = 5 and 
n4] =An+6an-1, n>2. 
Show by induction that a, = 3” — (—2)" if n > 1. 


Let aj = 2, a2 = 0, аз = —14, and 


ап+1 = 9an — 23dn—-1 + 15аһ-2, n> 3. 
Show by induction that a, = 3"^! — 5^7! + 2,n > 1. 
The Fibonacci numbers { Fa}; are defined by Fi = F, = 1 and 
Ёл+1 = Fn + Fu, п > 2. 
Prove by induction that 
@ + VS — 0 - v5)" 
Fy, = = 
2" 4/5 


Prove by induction that 
n! 


1 
nqa yy dy = —— —————— ———— 
| Т Т = гш тт 
if п is a nonnegative integer and r > —1. 
Suppose that m and n are integers, with 0 < m < n. The binomial coefficient (5 
m 
is the coefficient of t” in the expansion of (1 + t)”; that is, 


а+у" = У ME 


m=0 


From this definition it follows immediately that 


- Qe re 


For convenience we define 
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(«e emm 


and use this to show by induction on л that 


(a) Show that 


(b) Show that 


n mfn n nios 
2:00 (") =0 and у (") = 2". 
(с) Show that 


n 

n. n m n—m 

(x+y) -> (they : 
m=0 

(This is the binomial theorem.) 


20. Use induction to find an nth antiderivative of log x, the natural logarithm of x. 


21. Let fi(xı) = g1(x1) = xı. For n > 2, let 


Дл (х1, daos Xn) SA a XD + 2”? Xn + 


| А-1 Qa. Х2,..., Xn-1) = Pe | 
and 
gu rixae oo ЕЕ py Xa) 2 Xn — 
[89-1 (X1; X2,- -p Xn=1) — 27 7x]. 
Find explicit formulas for fj, (x1, Х2,..., Xn) and Zn (x1, X2, .. . , Xn). 
22. Prove by induction that 
: . е 1 — cos 2nx 
sinx + sin 3x + --- + sin(2n — 1)x = ——————, п> 1. 
2 sinx 


HINT: You will need trigonometric identities that you can derive from the identities 


cos(A — B) = cos Acos B + sin Asin B, 
cos(A + B) = cos Acos B — sin A sin B. 


Take these two identities as given. 
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23. Suppose that a; < a2 < -+> < an and bı € b2 <--- € bn. Let (64,£5,... ln} bea 
permutation of (1,2, ..., n}, and define 


Oi, 0... ln) = X (aj — bu. 
i=1 
Show that 
QU 125 ho > OU can: 


1.3 THE REAL LINE 


One of our objectives is to develop rigorously the concepts of limit, continuity, differen- 
tiability, and integrability, which you have seen in calculus. To do this requires a better 
understanding of the real numbers than is provided in calculus. The purpose of this section 
is to develop this understanding. Since the utility of the concepts introduced here will not 
become apparent until we are well into the study of limits and continuity, you should re- 
serve judgment on their value until they are applied. As this occurs, you should reread the 
applicable parts of this section. This applies especially to the concept of an open covering 
and to the Heine-Borel and Bolzano—Weierstrass theorems, which will seem mysterious at 
first. 


We assume that you are familiar with the geometric interpretation of the real numbers as 
points on a line. We will not prove that this interpretation is legitimate, for two reasons: (1) 
the proof requires an excursion into the foundations of Euclidean geometry, which is not 
the purpose of this book; (2) although we will use geometric terminology and intuition in 
discussing the reals, we will base all proofs on properties (A.)—(I) (Section 1.1) and their 
consequences, not on geometric arguments. 


Henceforth, we will use the terms real number system and real line synonymously and 
denote both by the symbol R; also, we will often refer to a real number as a point (on the 
real line). 


Some Set Theory 


In this section we are interested in sets of points on the real line; however, we will consider 
other kinds of sets in subsequent sections. The following definition applies to arbitrary 
sets, with the understanding that the members of all sets under consideration in any given 
context come from a specific collection of elements, called the universal set. In this section 
the universal set is the real numbers. 


Definition 1.3.1 Let S and T be sets. 


(a) S contains T, and we write S D T or T C S, if every member of T is also in S. In 
this case, T' is a subset of S. 


(b) $— Т isthe set of elements that are in 5 but not in T. 


(c) S equals Т, and we write S = Т, if S contains T and T contains S; thus, S = T if 
and only if S and T have the same members. 
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(d) S strictly contains T if S contains T but T does not contain 5; that is, if every 
member of T is also in S, but at least one member of S is not in T (Figure 1.3.1). 


(e) The complement of S, denoted by S*, is the set of elements in the universal set that 
are not in S. 


(f) The union of S and T, denoted by S U T, is the set of elements in at least one of S 
and T (Figure 1.3.1 (b)). 


(g) The intersection of S and T, denoted by 5 N T, is the set of elements in both S and 
T (Figure 1.3.1(c)). If S N T = 0 (the empty set), then S and Т are disjoint sets 
(Figure 1.3.1(d)). 


(h) A set with only one member xo is a singleton set, denoted by {xo}. 


SOT 


S U Т = shaded region 
(a) (b) 


CY) OC 


S r^ Т = shaded region SnTzÓ 
(c) (d) 
Figure 1.3.1 


Example 1.3.1 Let 


8 ={х|0<х<1}, T = (x |0 < x < 1 and x is rational] , 


and 
U = {x |0 <x < land х is irrational} . 


Then S D T and S D U, and the inclusion is strict in both cases. The unions of pairs of 
these sets are 


SUT-—S, SUU=S, аа TUU=S, 


and their intersections are 


SOT=T, SnhnU-U, and TAU = 0. 
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Also, 
S—-U-T and S-T —U. Г 


Every set S contains the empty set Ø, for to say that Ø is not contained in S is to say that 
some member of Ø is not in S, which is absurd since Ø has no members. If S is any set, 
then 

(5%) 2S and 50 55° = 0. 


If S is a set of real numbers, then 5 U S€ = R 


The definitions of union and intersection have generalizations: If F is an arbitrary col- 
lection of sets, then U (5 | SEF } is the set of all elements that are members of at least 
one of the sets in F, and N {$ | SEF } is the set of all elements that are members of every 
set in F. The union and intersection of finitely many sets S1, ..., Sn are also written as 
\ Ж—1 Sk and Ту, Sx. The union and intersection of an infinite sequence (S; )?? , of sets 

. oo oo 
are written as | Је; Sx and (34 Sx. 


Example 1.3.2 If F is the collection of sets 
Sp ={x|p<x<1+p}, 0<p<1/2, 
then 


45| Sp E€ F} = {x |0 <x < 3/2} and (){So|Sp € F} = {x|1/2 < x < 1). 


Example 1.3.3 If, for each positive integer k, the set S, is the set of real numbers 
that can be written as x = m/k for some integer m, then | JẸ; Sx is the set of rational 
numbers and ( 7. Sx is the set of integers. 


Open and Closed Sets 
If a and Р are in the extended reals and a « b, then the open interval (a, b) is defined by 
(a,b) = (x|a <x <b}. 


The open intervals (a, оо) and (—oo, b) are semi-infinite if a and b are finite, and (—оо, oo) 
is the entire real line. 


Definition 1.3.2 If xo isa real number and є > 0, then the open interval (xo—€, xo + €) 
is an e-neighborhood of xo. If a set S contains an e-neighborhood of xo, then S is a 
neighborhood of xo, and хо is an interior point of S (Figure 1.3.2). The set of interior 
points of S is the interior of S, denoted by S°. If every point of S is an interior point (that 
is, 50 = S), then S is open. A set S is closed if S^ is open. 
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S — four line segments 
X, 7 interior point of S 


Figure 1.3.2 


The idea of neighborhood is fundamental and occurs in many other contexts, some of 
which we will see later in this book. Whatever the context, the idea is the same: some defi- 
nition of “closeness” is given (for example, two real numbers are "close" if their difference 
is "small), and a neighborhood of a point хо is a set that contains all points sufficiently 
close to xo. 


Example 1.3.4 An open interval (a, b) is an open set, because if xo € (a,b) and 
€ < min(xo — a, b — xo}, then 


(xo — €, xo + €) C (a,b). 


The entire line R = (—oo, оо) is open, and therefore Ø (= IR^) is closed. However, Ø is 
also open, for to deny this is to say that Ø contains a point that is not an interior point, 
which is absurd because Ø contains no points. Since Ø is open, R (= 9°) is closed. Thus, 
R and 0 are both open and closed. They are the only subsets of R with this property 
(Exercise 1.3.18). E 


A deleted neighborhood of a point xo is a set that contains every point of some neigh- 
borhood of xo except for хо itself. For example, 


S = {x |0 < |x 2 xo| < e) 
is a deleted neighborhood of хо. We also say that it is a deleted e-neighborhood of хо. 


Theorem 1.3.3 
(a) The union of open sets is open. 
(b) The intersection of closed sets is closed. 


These statements apply to arbitrary collections, finite or infinite, of open and closed sets. 


Proof (а) Let Бе а collection of open sets and 
S -u(c|ces). 


If xo € S, then хо € Go for some Go in Є, and since Go is open, it contains some €- 
neighborhood of xo. Since Go C S, this e-neighborhood is in S, which is consequently a 
neighborhood of xo. Thus, S is a neighborhood of each of its points, and therefore open, 
by definition. 

(b) Let F be a collection of closed sets and T = N{F|F €F}. Then T^ = 
U {F° | Fe F} (Exercise 1.3.7) and, since each F* is open, Т is open, from (a). There- 
fore, T is closed, by definition. [| 
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Example 1.3.5 If —oo <a < b < оо, the set 
[a,b] = (x |a <x <b} 


is closed, since its complement is the union of the open sets (—oo, a) and (b, оо). We say 
that [a, b] is a closed interval. The set 


la, b) = {x |a cy « b) 
is a half-closed or half-open interval if —oo < a < b < oo, as is 
(a, b] = {х [а <x <b}; 


however, neither of these sets is open or closed. (Why not?) Semi-infinite closed intervals 
are sets of the form 


[a,00) = (x |a < x} and (—oo,a] = ix [x <a}, 


where a is finite. They are closed sets, since their complements are the open intervals 
(—oo, a) and (a, оо), respectively. mH 


Example 1.3.4 shows that a set may be both open and closed, and Example 1.3.5 shows 
that a set may be neither. Thus, open and closed are not opposites in this context, as they 
are in everyday speech. 


Example 1.3.6 From Theorem 1.3.3 and Example 1.3.4, the union of any collection of 
open intervals is an open set. (In fact, it can be shown that every nonempty open subset of 
IR is the union of open intervals.) From Theorem 1.3.3 and Example 1.3.5, the intersection 
of any collection of closed intervals is closed. E 


It can be shown that the intersection of finitely many open sets is open, and that the 
union of finitely many closed sets is closed. However, the intersection of infinitely many 
open sets need not be open, and the union of infinitely many closed sets need not be closed 
(Exercises 1.3.8 and 1.3.9). 


Definition 1.3.4 Let S be a subset of R. Then 
(a) хо is a limit point of S if every deleted neighborhood of xo contains a point of 5. 


(b) хо is a boundary point of S if every neighborhood of xo contains at least one point 
in S and one not in S. The set of boundary points of S is the boundary of S, denoted 
by 9S. The closure of S, denoted by S, is 5 = S US. 


(c) xo is an isolated point of S if хо € S and there is a neighborhood of xo that contains 
no other point of S. 


(d) xo is exterior to S if xo is in the interior of 5°. The collection of such points is the 
exterior of S. 


Example 1.3.7 Let S = (—oo, —1] U (1, 2) U {3}. Then 
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(a) The set of limit points of S is (Coo, —1] U [1, 2]. 

(b) aS = {-1,1,2,3}and $ = (оо, -1] U [1,2] U {3}. 
(c) 3isthe only isolated point of 5. 

(d) The exterior of S is (C1, 1) U (2, 3) U (3, оо). 


Example 1.3.8 Forn > 1, let 


I : : d S Up 
—|———,.— an = Я 
"C Lon T 2n xn 


Then 

(a) The set of limit points of S is S U {0}. 

(b) aS = {х |х 20orx = 1/n(n > 2) and $ = S U {0}. 
(c) S has no isolated points. 

(d) The exterior of S is 


Б 1 1 1 
[sere Ù (== zx) j (5). 


Example 1.3.9 Let 5 be the set of rational numbers. Since every interval contains а 
rational number (Theorem 1.1.6), every real number is a limit point of S; thus, 5 = R. 
Since every interval also contains an irrational number (Theorem 1.1.7), every real number 
is a boundary point of S; thus 05 = R. The interior and exterior of S are both empty, and 
S has no isolated points. S is neither open nor closed. E 


The next theorem says that S is closed if and only if S = S (Exercise 1.3.14). 
Theorem 1.3.5 A set S is closed if and only if no point of S^ is a limit point of S. 


Proof Suppose that S is closed and xo € S^. Since S^ is open, there is a neighborhood 
of xo that is contained in S^ and therefore contains no points of S. Hence, xo cannot be a 
limit point of S. For the converse, if no point of S* is a limit point of S then every point in 
S^ must have a neighborhood contained in S^. Therefore, S^ is open and S is closed. NI 


Theorem 1.3.5 is usually stated as follows. 
Corollary 1.3.6 A set is closed if and only if it contains all its limit points. 


Theorem 1.3.5 and Corollary 1.3.6 are equivalent. However, we stated the theorem as 
we did because students sometimes incorrectly conclude from the corollary that a closed 
set must have limit points. The corollary does not say this. If S has no limit points, then 
the set of limit points is empty and therefore contained in S. Hence, a set with no limit 
points is closed according to the corollary, in agreement with Theorem 1.3.5. For example, 
any finite set is closed. More generally, S is closed if there isa б > 0 such |x — y| > 6 for 
every pair (x, y) of distinct points in S. 
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Open Coverings 


A collection J€ of open sets is an open covering of a set S if every point in S is contained 
in a set H belonging to H; that is, if S C U (H | He H}. 


Example 1.3.10 The sets 


51 = [0, 1], $2 = {1,2,...,n,...}, 


1 1 
53 = CN? and S4 = (0,1) 
2 n 


are covered by the families of open intervals 


1 1 
Hı = I(x- wee + x) 0 <х < i , (N = positive integer), 
1 


N 
Hı = = 
n nt 


1 1 
H3 = | pe |2 о а 
п+5 п—»5 
and 
H4 = {(0, p)|0< p < 15, 
respectively. 


Theorem 1.3.7 (Heine-Borel Theorem) // Ж is an open covering ofa closed 
and bounded subset S of the real line, then S has an open covering H consisting of finitely 
many open sets belonging to H. 


Proof Since S is bounded, it has an infimum o and a supremum f, and, since $ is 
closed, o and В belong to 5 (Exercise 1.3.17). Define 


5; = S N [0,1] for t>a, 


and let 
F= {t | a < t < В and finitely many sets from # cover Se} : 


Since Sg = S, the theorem will be proved if we can show that В є F. To do this, we use 
the completeness of the reals. 


Since a € S, S, is the singleton set {a}, which is contained in some open set Hy from 
H because # covers S; therefore, a € F. Since F is nonempty and bounded above by В, 
it has a supremum y. First, we wish to show that y = В. Since y < В by definition of F, 
it suffices to rule out the possibility that у < В. We consider two cases. 
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CASE 1. Suppose that y < f and y d S. Then, since S is closed, y is not a limit point 
of S (Theorem 1.3.5). Consequently, there is an є > 0 such that 


[y - e. y - e] n S = 0, 


so Sy—e = Sy... However, the definition of y implies that Sy. has a finite subcovering 
from J£, while Sy+e does not. This is a contradiction. 


CASE 2. Suppose that y < В and y є S. Then there is an open set H, in H that 
contains у and, along with у, an interval [y — є, у + €] for some positive e. Since Sy—e has 
a finite covering (H1, ..., Hn} of sets from JC, it follows that Sy+e has the finite covering 
{Н,..., Hn, Hy). This contradicts the definition of y. 


Now we know that y = f, which is in S. Therefore, there is an open set Hg in # that 
contains В and along with В, an interval of the form [6 — e, В + є], for some positive є. 
Since Sg... is covered by a finite collection of sets (H1,..., Hy}, Sg is covered by the 
finite collection ( H1, .... Hy, Hg}. Since Sg = S, we are finished. ш 


Henceforth, we will say that a closed and bounded set is compact. The Heine-Borel 
theorem says that any open covering of a compact set S contains a finite collection that 
also covers S. This theorem and its converse (Exercise 1.3.21) show that we could just 
as well define a set S of reals to be compact if it has the Heine-Borel property; that is, if 
every open covering of S contains a finite subcovering. The same is true of R”, which we 
study in Section 5.1. This definition generalizes to more abstract spaces (called topological 
spaces) for which the concept of boundedness need not be defined. 


Example 1.3.11 Since Sı in Example 1.3.10 is compact, the Heine-Borel theorem 
implies that Sı can be covered by a finite number of intervals from #1. This is easily veri- 
fied, since, for example, the 2N intervals from J£, centered at the points x, = k/2N (0 < 
k < 2N — 1) cover Sj. 

The Heine-Borel theorem does not apply to the other sets in Example 1.3.10 since they 
are not compact: $5 is unbounded and $3 and S4 are not closed, since they do not contain 
all their limit points (Corollary 1.3.6). The conclusion of the Heine-Borel theorem does 
not hold for these sets and the open coverings that we have given for them. Each point in 
S2 is contained in exactly г one set from #2, so removing even one of these sets leaves a 
point of S5 uncovered. If J£ 5 is any finite collection of sets from #3, then 


- gU(H|H es) 


for n sufficiently large. Any finite collection ((0, рт), .. . , (0, о„)} from #4 covers only the 
interval (0, Pmax), where 
Pmax = Max{p1,..., Pn} < 1. 


The Bolzano—Weierstrass Theorem 


As an application of the Heine—Borel theorem, we prove the following theorem of Bolzano 
and Weierstrass. 
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Theorem 1.3.8 (Bolzano-Weierstrass Theorem) Every bounded infinite set 
of real numbers has at least one limit point. 


Proof We will show that a bounded nonempty set without a limit point can contain only 
a finite number of points. If S has no limit points, then S is closed (Theorem 1.3.5) and 
every point x of S has an open neighborhood Nx that contains no point of S other than x. 
The collection 

H = {Nx | x Є 5 } 


is an open covering for S. Since S is also bounded, Theorem 1.3.7 implies that S сап be 
covered by a finite collection of sets from #, say Nx,,..., Nx,. Since these sets contain 
only x1, ..., Xn from S, it follows that S = (x1,..., Xn}. E 


1.3 Exercises 


1. Find SOT,(SNT)*,S°NT*S,SUT,(S ОТ), and 5% ОТЕ. 
(a) 5 = (0,1),T = [2,2] (Ы) 5 = {x|x? > 4}, T = {x |x? < 9} 
(c) 5 = (-c0,00), T2 0 (d) 5 = (-oo,—1), Т = (1,0) 
2. Let 5; = (1— I/k,2-- 1/k], k > 1. Find 
AUS OAS OUS ON 5 
k=1 k=1 k=1 k=1 
3. Prove: If A and B are sets and there is a set X such that AU X = B U X and 
AN X = Bn X, then A = B. 
4. Find the largest є such that S contains an e-neighborhood of xo. 
(а) хо= 4.5 = [5.1) (Ы) х= 3,5 = [5.3] 
(с) хо = 5, S = (—1,œ) (4) хо = 1, S = (0,2) 
5. Describe the following sets as open, closed, or neither, and find 5 Е (S jo. and 
(S°)°. 
(a) S = (-1,2)U[B,oo) (b) 5 = (~œ, 1) U (2, оо) 
(с) S = [-3,-2] U[7,8] (9) 5 = {x |x = integer} 
6. Prove that (S N Т) = S"UT* and (5 ОТ) = S" n T*. 
T. Let F bea collection of sets and define 


Т=п{Е|ЕєЎ} and U=U{F|FeF}. 


Prove that (a) 1° = U {F° | F € F} and (b) О = (nF*| Fe F}. 


8. (a) Show that the intersection of finitely many open sets is open. 
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10. 


11. 


12. 
13. 
14. 


15. 


16. 
17. 
18. 
19. 


20. 


(b) Give an example showing that the intersection of infinitely many open sets 
may fail to be open. 

(a) Show that the union of finitely many closed sets is closed. 

(b) Give an example showing that the union of infinitely many closed sets may 
fail to be closed. 

Prove: 

(a) IfU isa neighborhood of xo and U C У, then V is a neighborhood of хо. 

(b) IfU;,..., Un are neighborhoods of xo, so is (№, Ui. 

Find the set of limit points of S, 0S, SS, the set of isolated points of S, and the 

exterior of S. 

(а) S = (~œ, 2) U (2,3) U {4} U(7, оо) 

(b) S = (all integers} 

(с) S=U{(n,n+1)|n = integer} 

(d) S= {x|x = 1/n,n = 1,2,3,...} 


Prove: A limit point of a set S is either an interior point or a boundary point of S. 


Prove: An isolated point of S is a boundary point of 5. 

Prove: 

(a) A boundary point of a set S is either a limit point or an isolated point of S. 
(b) A set S is closed if and only if 5 = 5. 


Prove or disprove: A set has no limit points if and only if each of its points is 
isolated. 


(a) Prove: If S is bounded above and В = sup S, then f є 0S. 

(b) State the analogous result for a set bounded below. 

Prove: If S is closed and bounded, then inf S and sup S are both in S. 

If a nonempty subset S of IR is both open and closed, then S = R. 

Let S be an arbitrary set. Prove: (a) 25 is closed. (b) S? is open. (c) The exterior 
of S is open. (d) The limit points of S form a closed set. (e) (S) =. 

Give counterexamples to the following false statements. 

(a) The isolated points of a set form a closed set. 

(b) Every open set contains at least two points. 

(c) If S; and S» are arbitrary sets, then 0(51 U S2) = 08, U 0S5. 

(d) If S, and 52 are arbitrary sets, then 0(S1 N $5) = 051 N 085. 

(e) The supremum of a bounded nonempty set is the greatest of its limit points. 
(f) If S is any set, then д(д5) = 05. 

(g) If S is апу set, then 05 = 05. 

(h) If S; and S» are arbitrary sets, then (S1 U $5)? = SPU 50. 


21. 


22. 


23. 


24. 
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Let S be a nonempty subset of R such that if J€ is any open covering of S, then S 
has an open covering Jc comprised of finitely many open sets from 3С. Show that 
S is compact. 

A set S is. inaset T if S C T C S. 


(a) Prove: If S and T are sets of real numbers and S С T, then S is dense in T 
if and only if every neighborhood of each point in T contains a point from S. 

(b) State how (a) shows that the definition given here is consistent with the re- 
stricted definition of a dense subset of the reals given in Section 1.1. 


Prove: 

(a) (S1 N S2)? = se n $0 (b) 80 U Se C (S1 U $5)? 
Prove: 

(a) 005, U $5) C OS; U 3S2 (b) 3(S1 n S2) C AS; U 085 
(c) 45 cas (d) aS = д5° 


(e) a(S — T) c ðS U 9T 


CHAPTER 2 


Differential Calculus of 


Functions of One Variable 


IN THIS CHAPTER we study the differential calculus of functions of one variable. 


SECTION 2.1 introduces the concept of function and discusses arithmetic operations on 
functions, limits, one-sided limits, limits at +00, and monotonic functions. 


SECTION 2.2 defines continuity and discusses removable discontinuities, composite func- 
tions, bounded functions, the intermediate value theorem, uniform continuity, and addi- 
tional properties of monotonic functions. 


SECTION 2.3 introduces the derivative and its geometric interpretation. Topics covered in- 
clude the interchange of differentiation and arithmetic operations, the chain rule, one-sided 
derivatives, extreme values of a differentiable function, Rolle’s theorem, the intermediate 
value theorem for derivatives, and the mean value theorem and its consequences. 


SECTION 2.4 presents a comprehensive discussion of L’ Hospital’s rule. 
SECTION 2.5 discusses the approximation of a function f by the Taylor polynomials of 


f and applies this result to locating local extrema of f. The section concludes with the 
extended mean value theorem, which implies Taylor's theorem. 


2.1 FUNCTIONS AND LIMITS 


In this section we study limits of real-valued functions of a real variable. You studied 
limits in calculus. However, we will look more carefully at the definition of limit and prove 
theorems usually not proved in calculus. 


A rule f that assigns to each member of a nonempty set D a unique member of a set Y 
is a function from D to Y. We write the relationship between a member x of D and the 
member y of Y that f assigns to x as 


y = f(x). 


The set D is the domain of Ў, denoted by D y. The members of Y are the possible values 
of f. If yo € Y and there is an xo in D such that f (xo) = yo then we say that f attains 
30 
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or assumes the value уо. The set of values attained by f is the range of f. A real-valued 
function of a real variable is a function whose domain and range are both subsets of the 
reals. Although we are concerned only with real-valued functions of a real variable in this 
section, our definitions are not restricted to this situation. In later sections we will consider 
situations where the range or domain, or both, are subsets of vector spaces. 


Example 2.1.1 The functions f, g, and h defined on (—oo, оо) by 
f(x) = х2, g(x) =sinx, and h(x) = е* 
have ranges [0, оо), [—1, 1], and (0, co), respectively. 
Example 2.1.2 The equation 
œ] = x (2.1.1) 


does not define a function except on the singleton set {0}. If x < 0, no real number satisfies 
(2.1.1), while if x > 0, two real numbers satisfy (2.1.1). However, the conditions 


РО) =x and f(x) 20 
define a function f on D y = [0, оо) with values f(x) = 4/x. Similarly, the conditions 
[GP =x and g(x) <0 


define a function g on Dg = [0, оо) with values g(x) = —./x. The ranges of f and g are 
[0, оо) and (—оо, 0], respectively. | 


It is important to understand that the definition of a function includes the specification 
of its domain and that there is a difference between f, the name of the function, and f(x), 
the value of f at x. However, strict observance of these points leads to annoying verbosity, 
such as "the function f with domain (—oo, оо) and values f(x) = x.” We will avoid this 
in two ways: (1) by agreeing that if a function f is introduced without explicitly defining 
D y, then D y will be understood to consist of all points x for which the rule defining 
f (x) makes sense, and (2) by bearing in mind the distinction between f and f(x), but not 
emphasizing it when it would be a nuisance to do so. For example, we will write consider 
the function f(x) = м1 — х2, rather than “consider the function f defined on [—1, 1] 
by f(x) = 41 — х2 or “consider the function g(x) = 1/ sin х rather than “consider 
the function g defined for x # Кл (k = integer) by g(x) = 1/sinx.” We will also write 
f = c (constant) to denote the function f defined by f(x) = c for all x. 


Our definition of function is somewhat intuitive, but adequate for our purposes. More- 
over, it is the working form of the definition, even if the idea is introduced more rigorously 
to begin with. For a more precise definition, we first define the Cartesian product X x Y 
of two nonempty sets X and Y to be the set of all ordered pairs (x, y) such that x € X and 
y € Y;thus, 

ХхҮ = {(x,y)|xeX,yeY}. 
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A nonempty subset f of X x Y is a function if no x in X occurs more than once as a first 
member among the elements of f. Put another way, if (x, y) and (x, y1) are in f, then 
y = yı. The set of x's that occur as first members of f is the of f. If x is in the domain 
of f, then the unique y in Y such that (x, y) € f is the value of f at x, and we write 
y = f(x). The set of all such values, a subset of Y , is the range of f. 


Arithmetic Operations on Functions 


Definition 2.1.11f D; D, Z 0, then f +g, f —g. and fg are defined on D f N Dg 
by 


(f + g)(x) = f(x) + (х), 
(f —g)() = f(x) – gx), 
and 


Cfg)x) = f(x)g(x). 
The quotient f/g is defined by 


for x in D y N Dg such that g(x) z 0. 


Example 2.1.3 If f(x) = /4— x? and g(x) = ух — 1, then Dy = [-2,2] and 
Dg = |1, оо), so f + g, f — g, and fg are defined on Dy N Dg = [1.2] by 


(f + gx) = VA— x? + мх Т, 
(f — gx) = V4A— x? — Vx — 1, 


and 
(fg)(x) = (V4— x?)(V x —1) = y (4 — х?)(х — 1). Q.1.2) 
The quotient f/g is defined on (1, 2] by 


E osque 


Although the last expression in (2.1.2) is also defined for —со < x < —2, it does not 
represent fg for such x, since f and g are not defined on (—oo, —2]. 


Example 2.1.4 Ifc is areal number, the function c f defined by (c f)(x) = cf (x) can 
be regarded as the product of f and a constant function. Its domain is D y. The sum and 
product of n (> 2) functions fi, ..., fn are defined by 


(А+»+ + ЛО) = A) + fat) +++ + fa) 
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and 
(Л fn) = fi) foe) +++ fn) (2.1.3) 
on D = ();_, Df, provided that D is nonempty. If fi = № = -:: = fn, then (2.1.3) 
defines the nth power of f: 
FE) = GG". 


From these definitions, we can build the set of all polynomials 
р(х) = ao - aix +--+ + anx”, 


starting from the constant functions and f(x) = x. The quotient of two polynomials is a 
rational function 
üj-F dix dee + anx” 
r(x) = ————————— (b 0). 
(2) = rum hm 0) 


The domain of r is the set of points where the denominator is nonzero. 


Limits 


The essence of the concept of limit for real-valued functions of a real variable is this: If L 
is a real number, then limy., 44 f(x) = L means that the value f(x) can be made as close 
to L as we wish by taking x sufficiently close to xo. This is made precise in the following 
definition. 


Figure 2.1.1 
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Definition 2.1.2 We say that f(x) approaches the limit L as x approaches xo, and 


write 
lim f(x) 2 L, 
X—X0 


if f is defined on some deleted neighborhood of хо and, for every є > 0, there isa ô > 0 


such that 

f(x) - L| <e 
if 

0 < [x — xo| < ô. 


Figure 2.1.1 depicts the graph of a function for which limy.,,, f(x) exists. 


Example 2.1.5 If c and x are arbitrary real numbers and f(x) = cx, then 
lim f(x) = схо. 
X—xo 
To prove this, we write 
| f(x) — exo] = |cx — exo| = [|х — xol. 


If c Z 0, this yields 
| f(x) — exo] < € 
if 
|x — xo| « 6, 


(2.1.4) 


(2.1.5) 


(2.1.6) 


where б is any number such that 0 < 6 < €/|c|. If c = 0, then f(x) – схо = 0 for all x, 


so (2.1.6) holds for all x. 


We emphasize that Definition 2.1.2 does not involve f(xo), or even require that it be 


defined, since (2.1.5) excludes the case where x — xo. 


Example 2.1.6 If 
1 
f(x) =xsin-—, x 40, 
x 
then 
lim f(x) = 0 
x0 
even though f is not defined at xo = 0, because if 
0«|x| < 8 = e, 


then 


1 
x sin—| < |x| < e. 
x 


| f(x) - 0| = 


On the other hand, the function 


1 
g(x) =sin-, x40, 
x 


has no limit as x approaches 0, since it assumes all values between —1 and 1 in every 


neighborhood of the origin (Exercise 2.1.26). 
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The next theorem says that a function cannot have more than one limit at a point. 


Theorem 2.1.3 Іт,» f(x) exists, then it is unique ; that is, if 


lim f(x)=L, and lim f(x) = Ls, (2.1.7) 
х->хо xx0 
then Ly = Lo. 


Proof Suppose that (2.1.7) holds and let € > 0. From Definition 2.1.2, there are positive 
numbers 6; and 82 such that 


|50) = | <є if O«l|x—xo| «ój, i =1,2. 
If = min(61, 82), then 


[Li — L| = La — f(x) + f(x) – L3] 
€|L1- f(x) -|f(x)—-La| «2e if 0«|x—xo| « ô. 


We have now established an inequality that does not depend on x; that is, 
|L4 — 15| < 2e. 
Since this holds for any positive e, L1 = L2. ш 
Definition 2.1.2 is not changed by replacing (2.1.4) with 
| f(x) — L| < Ke, (2.1.8) 


where K is a positive constant, because if either of (2.1.4) or (2.1.8) can be made to hold 
for any e > 0 by making |x — xo| sufficiently small and positive, then so can the other 
(Exercise 2.1.5). This may seem to be a minor point, but it is often convenient to work with 
(2.1.8) rather than (2.1.4), as we will see in the proof of the following theorem. 


A Useful Theorem about Limits 


Theorem 2.1.4 /f 


lim f(x) = L1 and lim g(x) = La, (2.1.9) 
х->хо х->хо 
then 
Jim (f + g)(x) = Li + La, (2.1.10) 
lim (f — g)(x) = L1— L2, (2.1.11) 
х X0 
lim (fg)(x) = Lı L2, (2.1.12) 
х->хо 
and, if Lz # 0, (2.1.13) 


lim (2) (х) = E (2.1.14) 
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Proof From (2.1.9) and Definition 2.1.2, if e > 0, there is a 6; > 0 such that 
|f) - Lil «€ (2.1.15) 
if 0 < |x — xo| < 61, and a 05 > O such that 
lg(x) – 12| < € (2.1.16) 
if 0 < |x — xo| < 52. Suppose that 
0 < |x — xo| < ô = min(61, 82), (2.1.17) 
so that (2.1.15) and (2.1.16) both hold. Then 


(7 = g)x) — (а x L2)| = [GF (x) — L1) + (g(x) — L2) 
< |70) — Lil + lg(x) — Lal < 2e, 


which proves (2.1.10) and (2.1.11). 
To prove (2.1.12), we assume (2.1.17) and write 


ICfg)(x) — L1L2| = | РО) (х) – Lı L2l 
= |f(x)(g(x) — L2) + L2(f(x) — 11) 
< |F@) lg) — L2] + |Lell f(x) — £4] 
< (fG)| + |L3]e (from (2.1.15) and (2.1.16)) 
< (0) — Lil + [Li] + [Lele 
< (e + |Liıl + |L2|)€ from (2.1.15) 
S XE [Li] [Zale 


if e < 1 and x satisfies (2.1.17). This proves (2.1.12). 
To prove (2.1.14), we first observe that if 1,2 5 0, there is a бз > 0 such that 
[L2] 
|80) — Lal < 77. 


so 
12| 


lg) > "m (2.1.18) 


if 
0 < |x — xo| < з. 
To see this, let L = L5 and e = |L2|/2 in (2.1.4). Now suppose that 


0 < |x — xo| < min(ô1, 42, дз), 


so that (2.1.15), (2.1.16), and (2.1.18) all hold. Then 
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Ho-t- 
Ё L2 g(x) L2 
_ [La f(x) = Lugo] 
Ig(x)L2| 
= 710270) - Lise) 
2 
— et al аЛ (from (2.1.18)) 
2 
= Lop Pall fe) = Ail 2 — 8091] 
< А (1221 + |Lilje (from (2.1.15) and (2.1.16)). 
L3]? 
This proves (2.1.14). [| 


Successive applications of the various parts of Theorem 2.1.4 permit us to find limits 
without the є arguments required by Definition 2.1.2. 


Example 2.1.7 Use Theorem 2.1 4 to find 
9— x? 


and — lim(9 — х2)(х + 1). 
x2 


Solution Ifc is a constant, then limx—xo c = c, and, from Example 2.1.5, lim, x. x = 
хо. Therefore, from Theorem 2.1.4, 


lim (9 — x?) 2 lim 9— lim x? 
x2 x2 x2 


= lim 9 — (lim x)? 
x2 x2 


=9-2?=5, 
and 
lim (x +1) = lim x + lim1=2+4+1=3. 
x2 x2 x2 
Therefore, 
9—2 lim (9 — x°) 5 
luncl———- mc 
x22 x +1 lim (x + 1) 3 
x2 
and 


lim (9 — x2)(x + 1) = lim(9 — х2) lim (x + 1) = 5-3 = 15. ш 
x2 x2 x2 
One-Sided Limits 


The function 


f(x) = 2x sin yx 
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satisfies the inequality 


7001 < e 


if0 < x < 8 = e/2. However, this does not mean that limy.,9 f(x) = 0, since f is 
not defined for negative x, as it must be to satisfy the conditions of Definition 2.1.2 with 
xo = 0 апа L = 0. The function 


X 
eG) - x PL, x £0, 


can be rewritten as 
x+1, x»0, 


80) = x—1l, x < 0; 


hence, every open interval containing хо = 0 also contains points x; and хә such that 
|g(x1) — g(x2)| is as close to 2 as we please. Therefore, lim, x, g(x) does not exist 
(Exercise 2.1.26). 

Although f(x) and g(x) do not approach limits as x approaches zero, they each exhibit 


a definite sort of limiting behavior for small positive values of x, as does g(x) for small 
negative values of x. The kind of behavior we have in mind is defined precisely as follows. 


lim fW=A lim о) = и 


X> XT x> X + 


Figure 2.1.2 


Definition 2.1.5 


a We say that f(x) approaches the left-hand limit L as x approaches xo from the left, 
y рр рр 
and write 


lim f(x)= L, 
x—>xo— 


if f is defined on some open interval (a, хо) and, for each є > 0, there isa ô > 0 
such that 
|[f(x)-Ll «e if xo—ó «x < xo. 
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(b) We say that f(x) approaches the right-hand limit L as x approaches xo from the 
right, and write 


lim f(x) = L, 
x—xo- 


if f is defined on some open interval (xo, b) and, for each є > 0, there isa ô > 0 
such that 
50) = L| «e if xo«x «xod 6. B 


Figure 2.1.2 shows the graph of a function that has distinct left- and right-hand limits at 
a point xo. 


Example 2.1.8 Let 
x 
f(x)2—. x0. 
|х| 
If x < 0, then f(x) = —x/x = —1,so 
lim f(x) = –1. 
If x > 0, then f(x) = х/х = 1, so 


E fe) = 


Example 2.1.9 Let 


1 1 
dos EN a hah 
x x 
If x < 0, then 
1 
g(x) = —x sin —, 
x 
so 
lim g(x) = 0, 
x->0- 
since í 
|g(x) — 0| = |x sin—| < |x| < € 
x 


if —e < x < 0; that is, Definition 2.1.5(a) is satisfied with 6 = є. If x > 0, then 
. 1 
g(x) = (2 + x)sin —, 
x 
which takes on every value between —2 and 2 in every interval (0, б). Hence, g(x) does not 


approach a right-hand limit at x approaches 0 from the right. This shows that a function 
may have a limit from one side at a point but fail to have a limit from the other side. 


40 Chapter 2 Differential Calculus of Functions of One Variable 


Example 2.1.10 We leave it to you to verify that 


lim хѕіп /x = 0, 
x->0+ 
and lim,_,9— sin х/х does not exist. ш 


Left- and right-hand limits are also called one-sided limits. We will often simplify the 
notation by writing 


lim. f(x) = f(xo—) and a f(x) = (хо). 


X—X0— 


The following theorem states the connection between limits and one-sided limits. We 
leave the proof to you (Exercise 2.1.12). 


Theorem 2.1.6 A function f has a limit at xo if and only if it has left- and right-hand 
limits at xo, and they are equal. More specifically, 


piu Pc 
if and only if 
f (xo) = f(xo-) = L. 


With only minor modifications of their proofs (replacing the inequality 0 < |x — xo| < ô 
by x9 —ó < x < xo or xo < x < xo + 8), it can be shown that the assertions of Theo- 
rems 2.1.3 and 2.1.4 remain valid if "lim," is replaced by "lim; хо” or “ту хо” 
throughout (Exercise 2.1.13). 


Limits at +оо 


Limits and one-sided limits have to do with the behavior of a function f near a limit point 
of D у. It is equally reasonable to study f for large positive values of x if D y is unbounded 
above or for large negative values of x if D f is unbounded below. 


Definition 2.1.7 We say that f(x) approaches the limit L as x approaches oo, and 
write 


lim f(x) = L, 
х->со 
if f is defined on an interval (a, оо) and, for each є > 0, there is a number В such that 


| f(x) = Ц «e if x». a 
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Figure 2.1.3 provides an illustration of the situation described in Definition 2.1.7. 


Figure 2.1.3 


We leave it to you to define the statement “lim, o5 f(x) = L” (Exercise 2.1.14) and 
to show that Theorems 2.1.3 and 2.1.4 remain valid if xo is replaced throughout by oo or 
—oo (Exercise 2.1.16). 


Example 2.1.11 Let 


1 2 
Tpocde ew = DEL. and h(x) = sinx. 
Then 
lim f(x) = 1, 
х=>се 
since 
Мо) Пе dee if ox 
x)-1|2—«e if x» =, 
x2 Je 
and 
lim g(x) = 2, 
X-—ROO 
since 
2x 2 2 : 2 
lg(x) - 2| = —2| = ——«—«e if x>-. 
l+x l+x x € 


However, liMmx—oo A(x) does not exist, since h assumes all values between —1 and 1 in any 
semi-infinite interval (т, со). 

We leave it to you to show that limy., f(x) = 1, limy., o5 g(x) = —2, and 
limy-+—o9 A(x) does not exist (Exercise 2.1.17). ш 
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We will sometimes denote limyoo f(x) and limy-oo f(x) by f(co) and f(—oo), 
respectively. 


Infinite Limits 


The functions А А 
Хо) =, 800) = 5. р(х) =sin—, 
x x x 

and 


1 
q(x) = = sin— 
x x 


do not have limits, or even one-sided limits, at хо = 0. They fail to have limits in different 
ways: 


e f(x) increases beyond bound as x approaches 0 from the right and decreases beyond 
bound as x approaches 0 from the left; 


e g(x) increases beyond bound as x approaches zero; 
e p(x) oscillates with ever-increasing frequency as x approaches zero; 


e q(x) oscillates with ever-increasing amplitude and frequency as x approaches 0. 


The kind of behavior exhibited by f and g near x9 = 0 is sufficiently common and 
simple to lead us to define infinite limits. 


Definition 2.1.8 We say that f(x) approaches co as x approaches xo from the left, 
and write 
lim f(x) = оо or /(хо—) = oo, 
x—>xo— 
if f is defined on an interval (a, xo) and, for each real number M, there is a ó > 0 such 
that 
f(x)» M if xg—ó «x < xo. 


Example 2.1.12 We leave it to you to define the other kinds of infinite limits (Exer- 
cises 2.1.19 and 2.1.21) and show that 


. ol . dl 
lim — — —oo, lim — — oc; 
x—0— x x04 X 
А 1 А f 
lim — = lim — = lim — = oc; 
x—0- x2 x04 х2 x20 x2 
lim x? = lim x? = oo; 
х=>се == 00 
and 
lim x? = oo, lim x? = –оо. ш 


х->со XxX—-—0o0 
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Throughout this book, “lim, +x, f(x) exists" will mean that 


lim f(x) 2 L, where L is finite. 
xX— X0 


To leave open the possibility that L = +оо, we will say that 


lim f(x) exists in the extended reals. 
X—X0 


This convention also applies to one-sided limits and limits as x approaches +оо. 


We mentioned earlier that Theorems 2.1.3 and 2.1.4 remain valid if "lim, x,” is re- 
placed by “іту хо” or “limy+x)4.” They are also valid with xo replaced by -Eoo. 
Moreover, the counterparts of (2.1.10), (2.1.11), and (2.1.12) in all these versions of The- 
orem 2.1.4 remain valid if either or both of Lı and L» are infinite, provided that their 
right sides are not indeterminate (Exercises 2.1.28 and 2.1.29). Equation (2.1.14) and its 
counterparts remain valid if Lı / L2 is not indeterminate and L5 4 0 (Exercise 2.1.30). 


Example 2.1.13 Results like Theorem 2.1.4 yield 


-— у LL JN CEP 
lim sinhx — lim —— - 5 (Jim е^ — lim e ) 
X—o00 x> X00 X— 00 
1 
== — = 0 = Б 
> (9e ) = о 
хех 1 
lim sinhx = lim 26 = = ( lim ех lim е) 
x—-—oo x—-—oo J 2 \х——оо X—-—o0 
= ~(0 — оо) = —oo, 
and 
"um _й 
lim —— = ————--——-0 
x00 x lim x оо 
оо 
Example 2.1.14 If 
f(x) = e - e, 
we cannot obtain ип. оо f(x) by writing 
lim f(x) = lim e?* — lim e", 
X—00 X—00 х->со 


because this produces the indeterminate form со — oo. However, by writing 
f(x) = e**(1-e™), 
we find that 


lim f(x) = ( Jim en) ( lim 1— lim e) = oc(1 — 0) = оо. 
х->со хоо х->со х->со 
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Example 2.1.15 Let 
2x?— x +1 


3x?--2x—-]1. 
Trying to find limy.,o5 g(x) by applying a version of Theorem 2.1.4 to this fraction as it is 
written leads to an indeterminate form (try it!). However, by rewriting it as 


g(x) — 


2—1/x + 1/x? 


MEET TET 


x £0, 
we find that 
В o y; s 2 
mu cues ШЕИ debel а 


lim g(x) = = 
x00 lim 3+ lim 2/x — lim 1/x 3+0-0 3 
A-—hOO x00. x—0oo 
Monotonic Function 
A function f is nondecreasing on an interval J if 

Ff (ху) € f(x2) whenever xı and хә are in J and xı < x2, (2.1.19) 
or nonincreasing on I if 

Ff (ху) = f(x2) whenever x; and x2 are in J and xı < x2. (2.1.20) 


In either case, f is on J. If < can be replaced by < in (2.1.19), f is increasing on I. If > 
can be replaced by > in (2.1.20), f is decreasing on 1. In either of these two cases, f is 
strictly monotonic on I. 


Example 2.1.16 The function 


0< 


ы 
A 


х, 
fœ) = Я 


‚15х52, 


is nondecreasing оп J = [0, 2] (Figure 2.1.4), and — f is nonincreasing on J = [0,2]. 


>< 
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Figure 2.1.4 


The function g(x) = x? is increasing on [0, 00) (Figure 2.1.5), 


Figure 2.1.5 


and h(x) = —x? is decreasing on (—oo, oo) (Figure 2.1.6). 


2 


Figure 2.1.6 
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In the proof of the following theorem, we assume that you have formulated the definitions 
called for in Exercise 2.1.19. 


Theorem 2.1.9 Suppose that f is monotonic on (a,b) and define 
a= inf f(x) and B= sup f(x). 
a<x<b 


a<x<b 
(a) If f is nondecreasing, then f(a+) = a and f(b—) = В. 


(b) Jf f is nonincreasing, then f(a+) = B and f(b—) = а. 
(Here a+ = —oo ifa = —oo and b— = co if b = co.) 


(c) Ifa < xo « b, then f (xo4-) and f (xo—) exist and are finite ; moreover, 
f(xo—) € f(xo) = fot) 


if f is nondecreasing, and 


f (xo—) = f(xo) > fot) 


if f is nonincreasing. 


Proof (a) We first show that f(a+) = о. If 


M > a, there is an хо in (a, b) such that f(xo) < M. Since f is nondecreasing, 
f(x) < M ifa < x < хо. Therefore, if a = —oo, then f(a+) = —oo. If a > —oo, let 
M = а + e, where e > 0. Then œ < f(x) « a + e,so 


|f(x) -a| «e if a«x «xo. (2.1.21) 


If a = —oo, this implies that f(—oo) = a. If a > —oo, let 6 = xo — a. Then (2.1.21) is 
equivalent to 
f(x) -a| «e if а<х<а+б, 
which implies that f (a+) = о. 
We now show that f(b—) = B. If M < В, there is an xo in (a, b) such that f(xo) > M. 


Since f is nondecreasing, f(x) > M if хб < x < b. Therefore, if В = oo, then 
f(b—) = œ. If B < co, let M = В — e, where e > 0. Then В — є < f(x) < B,so 
lfG)-Bl«e if xo«x«b. (2.1.22) 


If b = œ, this implies that f(co) = p. If b < co, let ё = b — xo. Then (2.1.22) is 
equivalent to 


lf(x) -B| «e if 2-6 <х <, 
which implies that f(b—) = В. 
(b) The proof is similar to the proof of (a) (Exercise 2.1.34). 
(c) Suppose that f is nondecreasing. Applying (a) to f on (a, xo) and (xo, b) sepa- 
rately shows that 


fGo-)- sup f(x) and f(xo+) = inf, fO). 


a<x<xo 


Section 2.1 Functions and Limits 47 


However, if x1 < xo < x2, then 


fœ) < (хо) < РО); 
hence, 


f(xo—) € (хо) € f(xot). 


We leave the case where f is nonincreasing to you (Exercise 2.1.34). E 


Limits Inferior and Superior 


We now introduce some concepts related to limits. We leave the study of these concepts 
mainly to the exercises. 

We say that f is bounded on a set S if there is a constant М < oo such that | f (x)| < М 
for all x in S. 


Definition 2.1.10 Suppose that f is bounded on [a, xo), where xo may be finite or oo. 
Fora < x « xo, define 


5 у(х; хо) = sup f(t) 


x<t<xo 
and 
T f(x; хо) = T и f. 
Then the left limit superior of f at xo is defined to be 
„Пт fG)- lim Ss; xo), 
and the left limit inferior of f at xo is defined to be 


lim f(x)- lim ly(xixo). 
X—X90— X—X0— 


(If хо = oo, we define xo— = оо.) 


Theorem 2.1.11 І f is bounded on [a, хо), then В = limy x4. f (x) exists and is 
the unique real number with the following properties : 


(a) Ife > 0, there is an ay in [a, xo) such that 
f(x)<Bte if а <х < xo. (2.1.23) 
(b) Ife» Oanda; is in [a, xo), then 
f(x)--e forsome x € [a1, xo). 


Proof Since f is bounded on [а, xo), 5 (х; хо) is nonincreasing and bounded on 
[а, xo). By applying Theorem 2.1.9(b) to S (x; хо), we conclude that В exists (finite). 
Therefore, if € > 0, there is an @ in [a, xo) such that 


B—e/2«Sy(xixo < В +6/2 if a xx «xo. (2.1.24) 
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Since S y (x; xo) is an upper bound of FO | x<t< xo}, f(x) < Sy; xo). Therefore, 
the second inequality in (2.1.24) implies (2.1.23) with a, = 9. This proves (a). To prove 
(b), let a; be given and define xı = max(a,,@). Then the first inequality in (2.1.24) 
implies that 

S (x1; xo) > B — €/2. (2.1.25) 


Since S у (х1; xo) is the supremum of MA | xi«t« xo}, there is an X in [x1, хо) such 
that 

f(x) > $у(х\; xo) – €/2. 
This and (2.1.25) imply that f(x) > f — e. Since x is in [a1, xo), this proves (b). 

Now we show that there cannot be more than one real number with properties (a) and 
(b). Suppose that В, < 2 and fj? has property (b); thus, if € > 0 and a; is in [a, xo), 
there is an x in [a1, xo) such that f(x) > Bo — є. Letting є = В — P1, we see that there 
is an Y in [a1, b) such that 


f(x) > Bo — (82 — B1) = Bi. 


so Ву cannot have property (a). Therefore, there cannot be more than опе real number 
that satisfies both (a) and (b). и 


The proof of the following theorem is similar to this (Exercise 2.1.35). 


Theorem 2.1.12 If f is bounded on [a, xo), then a = lim 
the unique real number with the following properties: 


f (x) exists and is 


X — X0 — 


(a) Ife» 0, there is an ay in [a, xo) such that 


f(x)>a-e if aj € x < xo. 
(b) Ife» Oanda; is in [a, xo), then 


f(x)«a-e forsomeX € [а1, xo). 


2.1 Exercises 


1. Each of the following conditions fails to define a function on any domain. State 


why. 
(a) sin f(x) 2 x (b) ef = —|x| 
(c) 1 - x? + [70)]2 =0 (d) FWI - 1] = x? 
2. If , 
f(x) = (x - (x +2) and g(x) = go x2 — 9, 
х—1 = 7 


find Dy, Drzg. D fg, and D fjg. 
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Find D y. 
1 
(a) f(x) = tan x (b) f(x) = NITE 
1 sin x 
(c) f(x) = aa (d) fe) = — 


(e) P =x, f(x) >20 


Find lim,_.x, f(x), and justify your answers with an e—ó proof. 


(а) x?7+2x+1, x=1 (b) 3. xo = 2 
X — 
1 
(c) 2р хо = 0 (а) Хх, хо = 4 
x?—1 


(60) гу 9) + Хо = 1 


Prove that Definition 2.1.2 is unchanged if Eqn. (2.1.4) is replaced by 
| f(x) - L| < Ke, 


where K is any positive constant. (That is, limx—>xo f(x) = L according to Defini- 
tion 2.1.2 if and only if іт, 5х f(x) = L according to the modified definition.) 


Use Theorem 2.1.4 and the known limits іту x = xo, Шух с = c to find 
the indicated limits. 


242 І І 
(a) lim алав (Ь) lim — 
хэ2 2х3 +1 x>2\x+1 x—1 
: x-1 . x8-—1 
К) age oe E OP 


Find іт, хо f(x) and іт, хок f(x), if they exist. Use є—б proofs, where ap- 
plicable, to justify your answers. 


1 1 1 
(а) ERA xo —0 cP) ces psi T Xo =0 
x * il " 
[x — 1| х*+х—2 
C) —— ——, х=1 (а)————  »=-—-2 
(б) UP: 0 ( ) X +2 0 


Prove: If h(x) > 0 fora < x < xo and limy_,x,— h(x) exists, then limx—>xo-— h(x) 
> 0. Conclude from this that if 5 (х) > fi (x) fora < x < xo, then 


lim fo(x)> lim fi(x) 
X—X0— X—X0— 


1f both limits exist. 
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10. 


11. 
12. 
13. 


14. 
15. 


16. 


17. 


18. 


19. 


20. 
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(a) Prove: If іт,» f(x) exists, there is a constant M and a p > 0 such that 
|f(x)) € M if 0 < |x — xo| < p. (We say then that f is bounded on 
{x [0 < |x — xol < p}.) 

(b) State similar results with “lim, x.” replaced by “limy—x9—.” 

(c) State similar results with “limx—>xọ” replaced by “limy—x +.” 

Suppose that іту f(x) = L and n is a positive integer. Prove that limx—>xọ [f (x)]" = 

L" (a) by using Theorem 2.1.4 and induction; (b) directly from Definition 2.1.2. 

HINT: You will find Exercise 2.1.9 useful for (b). 

Prove: If limy.,44 f(x) = L > 0, then іту +x) V f(x) = VL. 

Prove Theorem 2.1.6. 

(a) Using the hint stated after Theorem 2.1.6, prove that Theorem 2.1.3 remains 
valid with "lim, y," replaced by “іту 44." 

(b) Repeat (a) for Theorem 2.1.4. 

Define the statement "limy., o5 f(x) = L? 


Find lim, oo. f(x) ifit exists, and justify your answer directly from Definition 2.1.7. 
sinx sinx 


1 
(a) е (b) Б (a > 0) (c) me (a <0) 
(d) e™* sin x (e) tanx (£) e^? е2х 


Theorems 2.1.3 and 2.1.4 remain valid with “liMmx—xọ replaced throughout by 
“туо” “ту 5 оо’). How would their proofs have to be changed? 
Using the definition you gave in Exercise 2.1.14, show that 
| 1 _ 2|x| 
(a) lim (: 7 =) =| CE ETOT 


x>-o | +x 


(c) lim sinx does not exist 
X—-—0o 


Find limy., o5 f(x), if it exists, for each function in Exercise 2.1.15. Justify your 
answers directly from the definition you gave in Exercise 2.1.14. 


Define 
(a) lim (х) = –оо (b) lim f(x)-oo (с) lim /(х)=—оо 
X—X0— x—xo- x—xo- 
Find 
(a) dun 2 (b) їшї «S. 
x>0+ x3 х0 x3 
(Өн 26 (d) dun = 
x>0+ хб х-50— х6 
' D 1 
QE d RT (еура 


(k = positive integer) 


21. 


22. 


23. 


24. 


25. 


26. 


27. 
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Define 
(a) lim f(x) = оо (b) lim f(x) = —oo 
x—>xo X>X0 
Find 
(a) tim = (b) lim - 
x о х3 RH х6 
А 1 А 
(c) E (x == xo)?* (d) И. (х == хо)?Ё+1 
(К = positive integer) 
Define 
(a) lim f(x) = oo (b) lim f(x) = —oo 
X—>00 X—-—00 
Find 
: 2k : 2k 
(2) Ji s (b) „im s 
К 2k+1 ; 2k+1 
©) ims (D im x 
(k=positive integer) 
; А о ы 
(е) Jim мх sinx (£) Jim e 


Suppose that f and g are defined on (а, оо) and (c, оо) respectively, and that 
g(x) > aif x > c. Suppose also that limy+o f(x) = L, where —oo < L < оо, 
апа іту; оо g(x) = oo. Show that іту» f(g(x)) = L. 


(a) Prove: іт. f(x) does not exist (finite) if for some €o > 0, every deleted 
neighborhood of xo contains points x; and x2 such that 


|f G3) = fG2)| > є. 
(b) Give analogous conditions for the nonexistence of 


lim. f(x), lim f(x), lim f(x), and — lim fœ). 


x—xod- 


Prove: If —oo < хо < оо, then limy.,44 f(x) exists in the extended reals if and 
only if lim, 44 f(x) and limy_,x,+ (x) both exist in the extended reals and are 
equal, in which case all three are equal. 


In Exercises 2.1.28—2.1.30 consider only the case where at least one of L1 and L» is +оо. 


28. 


Prove: If limy.,44 f(x) = L1, бту хо g(x) = L5, and Lı + L2 is not indetermi- 
nate, then 

lim (f + g)(x) = Lı + L2. 

X— X0 


52 Chapter 2 Differential Calculus of Functions of One Variable 


29. 


30. 


31. 


32. 


33. 


34. 


35. 
36. 


37. 


Prove: If іп. оо f(x) = Lı, шо; оо g(x) = L2, and Lı L2 is not indeterminate, 
then 


Jim (fg)(x) = LiLo. 


(a) Prove: If limy+x . f(x) = Li, іт хо g(x) = L2 Æ 0, and L1/L2 is not 
indeterminate, then 
L 
lim (4) (x) = E 
хэхо \ g La 


(b) Show that it is necessary to assume that L2 Æ 0 in(a) by considering f(x) = 
sinx, g(x) = cos x, and xo = 7/2. 


Find 


3 3 
х? +2x4+3 x" + 2x +3 

a) lim ——————— b) lim ——————— 

LUPO (B) HE a 32 

2x4 + 3х2 +2 2x4 + 3х2 + 2 

(с) lim сс Ез (d) lim P De 
xo х3 2х +3 x>-00 х3 + 2х + 3 
уйны — e) булш a 


хэоо 2х + ех 
Find limy-+oo r (x) and у> оо r(x) for the rational function 
üg-baixd ee anx” 
r(x) = ——————————, 
bo + bix +--+ + bmx” 
where an 3% 0 and bm 0. 
Suppose that limy-.x,. f(x) exists for every хо in (a, b) and g(x) = f(x) except 


on a set S with no limit points in (а, b). What can be said about lim, x, g(x) for 
хо in (a, b)? Justify your answer. 


Prove Theorem 2.1.9(b), and complete the proof of Theorem 2.1.9(b) in the case 
where f is nonincreasing. 


Prove Theorem 2.1.12. 


Show that if f is bounded on [a, xo), then 
(a) lim f(x) < Hm fo). 
X—X0— 


X—X0— 


(b) lim (-/)(x)— — lim f(x)and lim (-/)(x)— — lim f(x). 
x—xo-— Xx—x0— Xx—x0— x—xo- 
(c) lim f(x) = lim f(x) if and only if lim; 4. f(x) exists, in which 
х->хо— x—x0— 
case 


im f(x) = lim f(x) = Tm f). 


x-X0— х—хо— 


Suppose that f and g are bounded on [a, xo). 
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(a) Show that 


„бт (f + 8)(x) = lim f(x) + lim go). 


(b) Show that 


lim (f + g)(x) = lim f(x)+ lim g(x). 


x—X0— X—X0— Xx—x0— 
(c) State inequalities analogous to those in (a) and (b) for 


lim (f —g)(x) and Tim (f —g)(x). 
x—x0— x—X0— 
38. Prove: liMx—>xọ— f(x) exists (finite) if and only if for each є > 0 there isa ô > 0 
such that | f(x1) — f(x2)| < € if xo — ô < х, xa < xo. HINT: For sufficiency, 
show that f is bounded on some interval (a, xo) and 


Tim f(x) = lim f(x). 


X—X0— 


Then use Exercise 2.1.36(c). 
39.  Supposethat f is bounded on an interval (xo, b]. Using Definition 2.1.10 as a guide, 
define limy 444. f(x) (the right limit superior of f at xo) and lim, —>х+ lr) (the 
right limit inferior of f at xo). Then prove that they exist. HINT: Use Theorem 2.1.9. 
40. Suppose that f is bounded on an interval (xo, b]. Show that lim, ,,,, f(x) = 
Timy—x + f(x) if and only if limyx + f(x) exists, in which case 


lim f(x)— lim f(x)— lim, f(x). 
+ x—>xo+ 


x—>xo+ х->хо 


41. Suppose that f is bounded on an open interval containing xo. Show Һат», f(x) 
exists if and only if 


lim f(x) = fim /(х)= lim f(x)- lim f). 
X—X0— X>XO X—X0— x—>xo+ 


in which case limx—xo f(x) is the common value of these four expressions. 


2.2 CONTINUITY 


In this section we study continuous functions of a real variable. We will prove some impor- 
tant theorems about continuous functions that, although intuitively plausible, are beyond 
the scope of the elementary calculus course. They are accessible now because of our better 
understanding of the real number system, especially of those properties that stem from the 
completeness axiom. 
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The definitions of 
f(xo-) = lim f(x) f(vot+) = lim f(x), and lim f(x) 
X—X0— x—xod- х->хо 


do not involve f(xo) or even require that it be defined. However, the case where f (хо) is 
defined and equal to one or more of these quantities is important. 


Definition 2.2.1 


(a) Wesay that f is continuous at xo if f is defined on an open interval (а, b) containing 
хо and Шт, хоу f(x) = f(xo). 

(b) We say that f is continuous from the left at xo if f is defined on an open interval 
(a, xo) and f(xo—) = f (xo). 

(c) We say that f is continuous from the right at xo if f is defined on an open interval 
(xo, b) and f(xo+) = f(xo). a 


The following theorem provides a method for determining whether these definitions are 
satisfied. The proof, which we leave to you (Exercise 2.2.1), rests on Definitions 2.1.2, 
2.1.5, and 2.2.1. 


Theorem 2.2.2 


(a) A function f is continuous at xo if and only if f is defined on an open interval (a, b) 
containing xo and for each € > О there is a 8 > 0 such that 


I f(x) — f(xo)| < € (2.2.1) 


whenever |x — xo| < 8. 


(b) A function f is continuous from the right at xo if and only if f is defined on ап 
interval [хо, b) and for each є > 0 there is a ё > 0 such that (2.2.1) holds whenever 
Xo € X < xo +6. 


(c) A function f is continuous from the left at xo if and only if f is defined on an interval 
(a, xo] and for each e > 0 


there is a 8 > 0 such that (2.2.1) holds whenever xo — ô < x < xo. 


From Definition 2.2.1 and Theorem 2.2.2, f is 


continuous at хо if and only if 
f (xo—) = f(xo+) = f(xo) 
or, equivalently, if and only if it is continuous from the right and left at xo (Exercise 2.2.2). 
Example 2.2.1 Let f be defined on [0, 2] by 


x?, 0<x <1, 


J0093. T 1<х<2 
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(Figure 2.2.1); then 


fO+) =0= f0), 
fd-)=14 fd) = 2, 
/а+)=2= TU. 
/@—)=3 = f2). 


Therefore, f is continuous from the right at 0 and 1 and continuous from the left at 2, but 
not at 1. If 0 < x, xo < 1, then 


| fx) — Ло) = Ix? — xol = Ix — xol lx + xol 
x2|x—xo| «e if ]|x— xo| < e/2. 


Hence, f is continuous at each xo in (0, 1). If 1 « x, xo « 2, then 


f(x) — f(xo)] = (x +1) — (xo + D = |x — xol 
«e if |x—xg| «e. 


Hence, f is continous at each хо in (1, 2). 


3 y=x+1, 1<х<2 
2 
1 y=x?, 0<х<1 


Figure 2.2.1 


Definition 2.2.3 A function f is continuous on an open interval (a, b) if it is continu- 
ous at every point in (a, b). If, in addition, 


f(b—) = fb) (2.2.2) 
or 


flat) = fa) (2.2.3) 
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then f is continuous on (a, b] or [a, b), respectively. If f is continuous on (a,b) and 
(2.2.2) and (2.2.3) both hold, then f is continuous on [a, b]. More generally, if S is a subset 
of D y consisting of finitely or infinitely many disjoint intervals, then f is continuous on S 
if f is continuous on every interval in S. (Henceforth, in connection with functions of one 
variable, whenever we say “ f is continuous on 5” we mean that S is a set of this kind.) 


Example 2.2.2 Let f(x) = /x,0 < х < oo. Then 
|/(х)— f(0| = J/x«e if 0<x<e?, 
so f(0+) = f(0). If xo > 0 and x > 0, then 


РО) — fGo)] = Ix — xol = 


|x — xol 
Sue 
A/Xo 


so limy+x9 f(x) = f'(xo). Hence, f is continuous on [0, оо). 


|x — xo| 


мх + Xo 
€ if |x—xo| « exo, 


Example 2.2.3 The function 


is continuous on S = LJ7*. 4, (n,n + 1). However, g is not continuous at any хо = n 


(integer), since it is not defined at such points. E 


The function f defined in Example 2.2.1 (see also Figure 2.2.1) is continuous on [0, 1) 
and [1, 2], but not on any open interval containing 1. The discontinuity of f there is of the 
simplest kind, described in the following definition. 


Definition 2.2.4 A function f is piecewise continuous on [a, b] if 

(а) f(xo+) exists for all xo in [a, b); 

(b) /f(xo—) exists for all xo in (a, b]; 

(c) f(xo+) = f(xo—) = f(xo) for all but finitely many points xo in (a, b). 

If (c) fails to hold at some xo in (a, b), f has a jump discontinuity at хо. Also, f has а 
jump discontinuity at a if f(a+) 5 f(a) orat bif f(b—) 5 f (b). 


Example 2.2.4 The function 


f(x) = 


(Figure 2.2.2) is the graph of a piecewise continuous function on [0, 3], with jump discon- 
tinuities at хо = 0, 1, 2, and 3. 
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Figure 2.2.2 


The reason for the adjective “jump” can be seen in Figures 2.2.1 and 2.2.2, where the 
graphs exhibit a definite jump at each point of discontinuity. The next example shows that 
not all discontinuities are of this kind. 


Example 2.2.5 The function 


f(x) = " 
0, x =0, 


is continuous at all хо except хо = 0. As x approaches 0 from either side, f(x) oscillates 
between —1 and 1 with ever-increasing frequency, so neither f(0+) nor f(0—) exists. 
Therefore, the discontinuity of f at 0 is not a jump discontinuity, and if p 0, then f is 
not piecewise continuous on any interval of the form [—p, 0], [—p, p], or [0, o]. El 


Theorems 2.1.4 and 2.2.2 imply the next theorem (Exercise 2.2.18). 


Theorem 2.2.5 If f and g are continuous on a set S, then so are f + g, f — g, and 
fg. In addition, f /g is continuous at each xo in S such that g(xo) # 0. 


Example 2.2.6 Since the constant functions and the function f(x) = x are continu- 
ous for all x, successive applications of the various parts of Theorem 2.2.5 imply that the 
function 

9— x? 


x+1 


r(x) = 
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is continuous for all x except x = —1 (see Example 2.1.7). More generally, by starting 
from Theorem 2.2.5 and using 


induction, it can be shown that if fi, fo, ..., f, are continuous on a set S, then so are 
Ait face fy and fi fo--- fa. Therefore, any rational function 


ао + a1x t: + anx” 
OT bae Балт Un 0 


is continuous for all values of x except those for which its denominator vanishes. 


Removable Discontinuities 


Let f be defined on a deleted neighborhood of xo and discontinuous (perhaps even unde- 
fined) at хо. We say that f has a at xo if limy 44 f(x) exists. In this case, the function 
f(x) if x € D y and x %# хо, 
gi lim f(x) ifx = xo, 
xX— X0 


1s continuous at Xo. 


Example 2.2.7 The function 


f(x)- nc 
x 


is not defined at хо = 0, and therefore certainly not continuous there, but іт, ьо f(x) = 0 
(Example 2.1.6). Therefore, f has a removable discontinuity at 0. 


The function i 
AQ) = sin = 
ре 


is undefined at 0 and its discontinuity there is not removable, since limx—>o / (х) does not 
exist (Example 2.2.5). 


Composite Functions 


We have seen that the investigation of limits and continuity can be simplified by regarding a 
given function as the result of addition, subtraction, multiplication, and division of simpler 
functions. Another operation useful in this connection is composition of functions; that is, 
substitution of one function into another. 


Definition 2.2.6 Suppose that f and g are functions with domains D у and Dg. If 
D, has a nonempty subset T' such that g(x) € Dy whenever x € T, then the composite 
function f o g is defined on T by 


Cf o g)(x) = f(g(x)). 
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Example 2.2.8 If 


1 
F(x) =logx and g(x) = —5, 
1— x? 
then 
Dy =(0,00) and Dg = {x|x #1}. 
Since g(x) > Oif x € T = (—1, 1), the composite function f о g is defined on (—1, 1) by 
1 
(f o g)(x) = log pes 
=x 
We leave it to you to verify that g o f is defined on (0, 1/e) U (1/e, e) U (e, оо) by 
1 
=з =——— B 
EO E = ая 
The next theorem says that the composition of continuous functions is continuous. 


Theorem 2.2.7 Suppose that g is continuous at хо, g(xo) is an interior point of D у, 
and f is continuous at g(xo). Then f o g is continuous at xo. 


Proof Suppose that e > 0. Since g(xo) is an interior point of D у and f is continuous 
at g(xo), there is a 61 > 0 such that f(t) is defined and 


If@) — f(g(xo)] «e if |t — g(xo)] < д. (2.2.4) 
Since g is continuous at хо, there is a ô > 0 such that g(x) is defined and 
lg(x) – g(xo)) «à1 if |x —xo| <ô. (2.2.5) 


Now (2.2.4) and (2.2.5) imply that 
If(g(x)) — f(g(xo)| «e if |х—хо| < ô. 


Therefore, f o g is continuous at xo. ш 


See Exercise 2.2.22 for a related result concerning limits. 


Example 2.2.9 In Examples 2.2.2 and 2.2.6 we saw that the function 
f(x) = Vx 
is continuous for x > 0, and the function 
9 — x? 
x+1 


is continuous for х Z —1. Since g(x) > Oif x < —30r —1 < x < 3, Theorem 2.2.7 
implies that the function 


g(x) = 


9 — x2 
x+1 


is continuous on (—oo, —3) U (—1, 3). It is also continuous from the left at —3 and 3. 


(f og)x) = 
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Bounded Functions 
A function f is bounded below ona set S if there is a real number m such that 
f(x) =m forall x € S. 


In this case, the set 
Ү = {ғо) |х es) 
has an infimum о, and we write 
a = inf f(x). 
xeS 


If there is a point xı іп S such that f(x,) = a, we say that o is the minimum of f on S, 
and write 


a= min F(x). 


Similarly, f is bounded above on S if there is a real number M such that f(x) < M for 
all x in S. In this case, V has a supremum f, and we write 


B — sup f(x). 
xeS 


If there is a point x2 in S such that f(x2) = В, we say that В is the maximum of f on S, 
and write 


В = max f(x). 


If f is bounded above and below on a set S, we say that f is bounded on S. 


Figure 2.2.3 illustrates the geometric meaning of these definitions for a function f 
bounded on an interval 5 = [a,b]. The graph of f lies in the strip bounded by the 
lines y = M and y = m, where M is any upper bound and m is any lower bound 
for f on [a,b]. The narrowest strip containing the graph is the one bounded above by 
y = В = supg<x<p f(x) and below by y = а = infg<x<p f(x). 


Figure 2.2.3 
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Example 2.2.10 The function 


i, x=0 or x=1, 


g(x) = + 
l-x, O0<x<l, 


(Figure 2.2.4(a)) is bounded on [0, 1], and 
sup g(x) = 1, inf g(x) =0. 
0<х<1 0<х<1 

Therefore, g has no maximum ог minimum ор [0, 1], since it does not assume either of the 
values 0 and 1. 

The function 

Ах) = 1-х, 0<х<1, 

which differs from g only at 0 and 1 (Figure 2.2.4(b)), has the same supremum апа infi- 


mum as g, but it attains these values at x = 0 and x = 1, respectively; therefore, 


max h(x)=1 and min A(x) =0. 
0<x<1 0<х<1 


(а) 


Figure 2.2.4 


Example 2.2.11 The function 


f(x)- е*®—1) gin 


О<х <1, 


1 
x(x -1)’ 
oscillates between +e*@~ infinitely often in every interval of the form (0, p) or (1—p, 1), 
where 0 < p < 1, and 


sup f(x)=1, pint, f(x) = -1. 


0<x<1 


However, f does not assume these values, so f has no maximum or minimum on (0, 1). 
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Theorem 2.2.8 If f is continuous on a finite closed interval |a, b], then f is bounded 
on [a, b]. 


Proof Suppose that t є [a,b]. Since f is continuous at f, there is an open interval J; 
containing ¢ such that 


|0) = ft) «1 if xelnl[a,b]. (2.2.6) 


(To see this, set € = 1 in (2.2.1), Theorem 2.2.2.) The collection # = (1, |a < t x b] is 
an open covering of [a,b]. Since [a, b] is compact, the Heine-Borel theorem implies that 
there are finitely many points t1, t2, ..., f£, such that the intervals I;,, It, ..., It, cover 
[a, b]. According to (2.2.6) with t = ti, 


|0) = f(t)) «1 if xel, N [a,b]. 


Therefore, 
о) = (Ло) — FG) + fG x 170) – fa + fl (2.2.7) 
<14+|f(t)| if x€ Ts, N [a,b]. i 
Let 
М =1+ max | f (ti)]. 
Since [а,Ь] c 25 (Ii; n [a, b]), (2.2.7) implies that | f(x)| < M if x € [а,Ь]. ш 


This proof illustrates the utility of the Heine-Borel theorem, which allows us to choose 
M as the largest of a finite set of numbers. 


Theorem 2.2.8 and the completeness of the reals imply that 


if f is continuous on a finite closed interval [a, b], then f has an infimum and a supre- 
mum on [a,b]. The next theorem shows that f actually assumes these values at some 
points in [a, b]. 


Theorem 2.2.9 Suppose that f is continuous on a finite closed interval [a, b]. Let 


a= inf f(x) and B= sup f(x). 


a<x<b 


Then о and В are respectively the minimum and maximum of f on |a, b]; that is, there are 
points xy and x» in |a, b] such that 


fœ) = а and  f(x2)- В. 


Proof We show that x; exists and leave it to you to show that x» exists (Exercise 2.2.24). 


Suppose that there is no x; in [a,b] such that f(x1) = a. Then f(x) > o for all 
x € [a, b]. We will show that this leads to a contradiction. 


Suppose that t € [а, b]. Then f(t) > о, so 
t 
foa. 


Jure 
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Since f is continuous at f, there is an open interval J; about f such that 


/@) +а 
2 


f(x) > if xel N [a,b] (2.2.8) 


(Exercise 2.2.15). The collection # = Uu | a<t< b} is an open covering of [a, b]. Since 
la, b] is compact, the Heine-Borel theorem implies that there are finitely many points г], 


t2, ..., fy such that the intervals Л, In, ..., It, cover [а, b]. Define 
. f(ti) c o 
a, = min ———-—. 
1<і<п 2 


Then, since [a,b] C UF s; N [a, Ь]), (2.2.8) implies that 
ft) >a, a<t<b. 


But à > а, so this contradicts the definition of œ. Therefore, f(x1) = o for some x, in 
[a, b]. ш 


Example 2.2.12 We used the compactness of [а,Ь] in the proof of Theorem 2.2.9 


when we invoked the Heine-Borel theorem. To see that compactness is essential to the 
proof, consider the function 


g(x) =1-d d 
x 


which is continuous and has supremum 2 on the noncompact interval (0, 1], but does not 
assume its supremum on (0, 1], since 


. 1 
sin — 
x 


g(x) <1+(1-x) 


<1+(1—х)<2 if O<x<l. 
As another example, consider the function 
f(x) =e™, 


which is continuous and has infimum 0, which it does not attain, on the noncompact interval 
(0, oo). ш 


The next theorem shows that if f is continuous оп а finite closed interval [a, b], then f 
assumes every value between f(a) and f(b) as x varies from a to b (Figure 2.2.5, page 64). 


Theorem 2.2.10 (Intermediate Value Theorem) Suppose that f is con- 
tinuous on [а, b], f(a) = f(b), and и is between f(a) and f(b). Then f(c) = џи for 


some c in (a, b). 
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у= (х) 


Figure 2.2.5 


Proof Suppose that f(a) < u < f(b). The set 
S={x|a<x<b and f(x)< uj 


is bounded and nonempty. Let с = sup S. We will show that f(c) = џи. If f(c) > p, 
then c > a and, since f is continuous at c, there is an € > 0 such that f(x) > wif 
Cc —€ < x < c (Exercise 2.2.15). Therefore, c — є is an upper bound for S, which 
contradicts the definition of c as the supremum of 5. If f(c) < џи, then c < b and there is 
an є > 0 such that f(x) < u fore < x < c + є, soc is not an upper bound for S. This is 
also a contradiction. Therefore, f(c) = и. 


The proof for the case where f(b) < u < f(a) can be obtained by applying this result 
to — f. a 


Uniform Continuity 


Theorem 2.2.2 and Definition 2.2.3 imply that a 


function f is continuous on a subset S of its domain if for each € > 0 and each xg in S, 
there isa ё > 0, which may depend upon xo as well as є, such that 


f(x) – f(xo)) «e if |x—xo| <ô and xe Dy. 
The next definition introduces another kind of continuity on a set S. 


Definition 2.2.11 A function f is uniformly continuous on a subset S of its domain 
if, for every є > 0, there is a ё > 0 such that 


| f(x) — f(x’)| < e whenever |x — x'| < à and x, x’ € S. ш 


We emphasize that in this definition 6 depends only оп є and S and not on the particular 
choice of x and x’, provided that they are both in S. 


Example 2.2.13 The function 
f(x) = 2x 
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is uniformly continuous on (—оо, оо), since 
| f(x) — f(x’)| 22ix 2x! «e if |x—x'| < ey2. 
Example 2.2.14 If 0 <r < оо, then the function 
g(x) = х? 
is uniformly continuous on [—r, r]. To see this, note that 
lgG) — g(x’) = |x? - (х)°| = Ix — "| x  x'| 2rlx — x’, 
so 


lg(x) – g(x’)| «e if ex] <8 = T and —r < x, x’ <r. и 


Often a concept is clarified by considering its negation: a function f is not uniformly 
continuous on S if there is an єо > 0 such that if ô is any positive number, there are points 
x and x’ in S such that 


Ix -x'! «8. but |f(x)— f(x’)| > €o. 


Example 2.2.15 The function g(x) = x? is uniformly continuous on [—r, r] for any 
finite r (Example 2.2.14), but not on (—оо, оо). To see this, we will show that if ô > 0 
there are real numbers x and x’ such that 


|x—x'| 28/2 and |g(x) — £6) > 1. 
To this end, we write 
IgG) — 86] = Ix? (0) = Ix 1х x’. 
If |x — x'| = 6/2 and x, x’ > 1/6, then 
2 6f1 1 
|х—х||х+х|> 5 <+-<|=1. 
Example 2.2.16 The function 


f(x) = cos L 
x 


is continuous on (0, 1] (Exercise 2.2.23(i)). However, f is not uniformly continuous on 


(0, 1], since 
1 1 
ko) (|2. nma . 


Examples 2.2.15 and 2.2.16 show that a function may be continuous but not uniformly 
continuous on an interval. The next theorem shows that this cannot happen if the interval 
is closed and bounded, and therefore compact. 
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Theorem 2.2.12 If f is continuous on a closed and bounded interval [a, b], then f 
is uniformly continuous on [а, b]. 


Proof Suppose that e > 0. Since f is continuous on [a, b], for each t in [a, b] there is 
a positive number б, such that 


f(x) — ft <$ if |x—t| <28, and xe [a,b]. (2.2.9) 
If J, = (t — ôt, t + ôt), the collection 
H = (L |t € [a,b]) 


is an open covering of [a, b]. Since [a, b] is compact, the Heine-Borel theorem implies that 


there are finitely many points t1, t2, ..., tn in [а,Ь] such that Jj, In, ..., Ie, cover [a, b]. 
Now define 
ô = min(ó;, , б, TET Stn . (2.2.10) 
We will show that if 
|x —x'| <5 and x,x' € [a,b], (2.2.11) 


then | f(x) — f(x^)| < e. 


From the triangle inequality, 


IF) - £01 = (FO) — £6) + FG) — FO) re 
s |f(x) FEA + 1f) — 70. 
Since Л, In, ..., І, cover [a, b], x must be in one of these intervals. Suppose that x € /,,; 
Is |x — t | < às. (2.2.13) 
From (2.2.9) with t = tr, 
РО) = fl < 5. (2.2.14) 


From (2.2.11), (2.2.13), and the triangle inquality, 


|x’ t| = (x — x) + (x ol € |x’ — x] 4+ |x ^ tj] <8 &„ < 25s. 


Therefore, (2.2.9) with t = t, and x replaced by x’ implies that 
€ 
ра) = 7091 < 5. 


This, (2.2.12), and (2.2.14) imply that | f(x) — f(x’)| < є. ш 


This proof again shows the utility of the Heine-Borel theorem, which allowed us to 
define 6 in (2.2.10) as the smallest of a finite set of positive numbers, so that б is sure to be 
positive. (An infinite set of positive numbers may fail to have a smallest positive member; 
for example, consider the open interval (0, 1).) 


Corollary 2.2.13 If f is continuous on a set T, then f is uniformly continuous on 
any finite closed interval contained in T. 
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Applied to Example 2.2.16, Corollary 2.2.13 implies that the function g(x) = cos 1/x 
is uniformly continuous on [p, 1] if0 < p < 1. 


More About Monotonic Functions 


Theorem 2.1.9 implies that if f is monotonic on an interval /, then f is either continuous 
or has a jump discontinuity at each xo in Z. This and Theorem 2.2.10 provide the key to 
the proof of the following theorem. 


Theorem 2.2.14 If f is monotonic and nonconstant on |a, b], then f is continuous on 
la, b] if and only if its range Ку = {f(x) | x € [a, bj} is the closed interval with endpoints 
f(a) and f(b). 


Proof We assume that f is nondecreasing, and leave the case > where f is nonincreasing 
to you (Exercise 2.2.34). Theorem 2.1.9(a) implies that the set R f = { f(x) | x € (a, b)} 
is a subset of the open interval (f (a+), f(b—)). Therefore, 


Ry = (f(aY U Rr UCf(D) CLF@}U (f+), fO- U(f(b). (2.2.15) 


Now suppose that f is continuous on [a,b]. Then f(a) = f(a+), f(b—) = f(b), so 
(2.2.15) implies that Ry C [f(a), f(b)]. If f(a) < u < f(b), then Theorem 2.2.10 
implies that и = f(x) for some x in (a, b). Hence, Ry = [f (a), f (b)]. 

For the converse, suppose that Ку = [f (а), f(b)]. Since f(a) € f(at+) and f(b—) < 
f (b), (2.2.15) implies that f(a) = f(a+) and f(b—) = f(b). We know from Theo- 
rem 2.1.9(c) that if f is nondecreasing and a < xo < b, then 


f(xo-) € (хо) € f(xot). 


If either of these inequalities is strict, R у cannot be an interval. Since this contradicts 
our assumption, f(xo—) = (хо) = f(xo--). Therefore, f is continuous at хо (Exer- 
cise 2.2.2). We can now conclude that f is continuous on [a, b]. a 


Theorem 2.2.14 implies the following theorem. 


Theorem 2.2.15 Suppose that f is increasing and continuous on [a, b], and let f(a) = 
c and f (b) = d. Then there is a unique function g defined on |c, d] such that 


(70) =x, azxszb, (2.2.16) 
and 

f(g) =y, схуха. (22.17) 
Moreover, g is continuous and increasing on |c, а]. 
Proof We first show that there is a function g satisfying (2.2.16) and (2.2.17). Since f 


is continuous, Theorem 2.2.14 implies that for each yo in [c, d] there is an xo in [a, b] such 
that 


f (xo) = yo. (2.2.18) 
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and, since f is increasing, there is only one such xo. Define 


g(Yo) = xo. (2.2.19) 


The definition of xo is illustrated in Figure 2.2.6: with [c, d] drawn on the y-axis, find the 
intersection of the line y = yo with the curve y = f(x) and drop a vertical from the 
intersection to the x-axis to find xo. 


d y-fQ) 


Figure 2.2.6 


Substituting (2.2.19) into (2.2.18) yields 


f(g(vo)) = уо, 
and substituting (2.2.18) into (2.2.19) yields 


gf (xo)) = хо. 
Dropping the subscripts in these two equations yields (2.2.16) and (2.2.17). 
The uniqueness of g follows from our assumption that f is increasing, and therefore 
only one value of хо can satisfy (2.2.18) for each yo. 


To see that g is increasing, suppose that yı < y2 and let x; and x2 be the points in [а,Ь] 
such that f/(x41) = yı and f(x2) = ya. Since f is increasing, xı < x2. Therefore, 


#01) = х < = g(y2). 


so g is increasing. Since Rg = {g(y) | y € [с, d]) is the interval [e(c), g(d)] = [a,b], 
Theorem 2.2.14 with f and [a, b] replaced by g and [c, d] implies that g is continuous on 
[с, а]. ш 

The function g of Theorem 2.2.15 is the inverse of f, denoted by f^. Since (2.2.16) 


and (2.2.17) are symmetric in f and g, we can also regard f as the inverse of g, and denote 


itbyg !. 
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Example 2.2.17 If 
Р) = х?, 0<x<R, 


then 
flO) =a) = уу, OS ys R’. 
Example 2.2.18 If 
f(x) =2x+4, O<x <2, 
then 
JTO = 800) = = 4<у<8. 


2.2 Exercises 


1. Prove Theorem 2.2.2. 


2. Prove that a function f is continuous at хо if and only if 


lim /()- lim | f(x) = fo). 


3. Determine whether f is continuous or discontinuous from the right or left at xo. 
(a) f(x) = "d (xo —0) (b) Дх) = Vx (хо > 0) 
(c) f(x) 2 — (xo 20) (d) f(x) = x? (xo arbitrary) 


x 

(е) fey = [rm TTA qo 
Grasp e mo 

х+|х|Ч+х) 1 
(fem xX FPP 00) 

, х = 

4. Let f be defined on [0, 2] by 
2 0<x<l, 


fœ) = 


x+1, 1<х<2. 


On which of the following intervals is f continuous according to Definition 2.2.3: 
[0, 1), (0, 1), (0, 1], [0, 1], [1, 2), (1, 2), (1, 2], [1, 2]? 


5. Let E 
X 

g(x) = ——. 

х—1 


On which of the following intervals is g continuous according to Definition 2.2.3: 
[0, 1), (0, 1), (0, 1], [1, оо), (1, оо)? 
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10. 


11. 


12. 


13. 


14. 


15. 
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Let 
-] if x is irrational, 


f(x) = 


1 if x is rational. 


Show that f is not continuous anywhere. 


Let f(x) = 0 if x is irrational and f(p/q) = 1/q if p and q are positive inte- 
gers with no common factors. Show that f is discontinuous at every rational and 
continuous at every irrational on (0, oo). 


Prove: If f assumes only finitely many values, then f is continuous at a point xo in 
D^ if and only if f is constant on some interval (xo — б, xo + ô). 


The characteristic function wr of a set T is defined by 


l, xer, 


Aa 


Show that wr is continuous at a point xo if and only if xo € T? U (T°)°. 

Prove: If f and g are continuous on (a, b) and f(x) = g(x) for every x in a dense 
subset (Definition 1.1.5) of (a, b), then f(x) = g(x) for all x in (а,Ь). 

Prove that the function g(x) = log x is continuous on (0, оо). Take the following 
properties as given. 

(a) іт, g(x) = 0. 

(b) g(x1) + g(x2) = g(x1x2) if x1, x2 > 0. 

Prove that the function f(x) = е is continuous on (—oo, оо). Take the following 
properties as given. 


(a) іт, о f(x) = I. 

(b) А +) = fx) (о), — < xi, x2 < оо. 

(a) Prove that the functions sinh x and cosh x are continuous for all x. 

(b) For what values of x are tanh x and coth x continuous? 

Prove that the functions s(x) = sin x and c(x) = cos x are continuous on (—oo, оо). 

Take the following properties as given. 

(a) іт, ос(х) = 1. 

(b) eG — хә) = с(ху)с(хә) + s(x1)s (x2), —оо < x1, x2 < oo. 

(c) 52(х) + с2(х) = 1, -oo «x «oo. 

(a) Prove: If f is continuous at хо апа / (хо) > p, then f(x) > p for all x in 
some neighborhood of xo. 

(b) State a result analogous to (a) for the case where /(хо) < и. 

(c) Prove: If f(x) < и for all x in S and xo is a limit point of S at which f is 
continuous, then f (xo) < џи. 

(d) State results analogous to (a), (b), and (c) for the case where f is contin- 
uous from the right or left at xo. 


16. 


17. 


18. 
19. 


20. 


21. 


22. 


23. 


24. 
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Let | f| be the function whose value at each x in Dy is | f(x)|. Prove: If f is 
continuous at xo, then so is | f |. Is the converse true? 


Prove: If f is monotonic on [a, 5], then f is piecewise continuous on [a, 5] if and 
only if f has only finitely many discontinuities in [a, b]. 


Prove Theorem 2.2.5. 
(a) Show that if fi, fo, ..., Jn are continuous on a set S then so are fy + fo + 


eO Sh and fi f5--- fa. 
(b) Use (a) to show that a rational function is continuous for all values of x 
except the zeros of its denominator. 


(a) Let fı and fz be continuous at xo and define 


F(x) = max (fi (x), R). 


Show that F is continuous at xo. 
(b) Let fi, fo,..., Jn be continuous at xo and define 


F(x) = max (fA(x), fo(x),..., fr(®))- 


Show that F is continuous at xo. 
Find the domains of f o g and go f. 
(а) f@=V%, #0) =1-х2 — (b)fG)-logx, g(x)-sinx 
1 z 
(c) f(x) = IL g(x)-—cosx (а) f(x) = ух, g(x) —sin2x 
a) Suppose that уо = Шт», g(x) exists and is an interior point of D f, and 
pP y o8 P f 
that f is continuous at yo. Show that 


lim (f o g)(x) = fo). 


(b) State an analogous result for limits from the right. 
(c) State an analogous result for limits from the left. 


Use Theorem 2.2.7 to find all points xo at which the following functions are contin- 
uous. 


(a) V1 — x? (b) sine (c) log(1 + sin x) 


(yan (SS) 


(g) (1 — sin? x)1/? (h) cot(1 — е7*) (i) cos 


(d) e-/072) (e) sin 


1 
(x — 1)? 


Complete the proof of Theorem 2.2.9 by showing that there is an x2 such that 


Дх») = В. 
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25. 


26. 


27. 


28. 


29. 


30. 


31. 


32. 


33. 
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Prove: If f is nonconstant and continuous on an interval /, then the set 5 = 
{ y | y= f(x), xel } is an interval. Moreover, if J is a finite closed interval, then 
sois S. 


Suppose that f and g are defined on (—оо, оо), f is increasing, and f o g is con- 
tinuous on (—oo, оо). Show that g is continuous on (—oo, оо). 


Let f be continuous on [a, b), and define 


F(x) = max fi), azx«b. 


(How do we know that F is well defined?) Show that F is continuous on [a, b). 
Let f and g be uniformly continuous on an interval S. 


(a) Show that f + g and f — g are uniformly continuous on S. 
(b) Show that fg is uniformly continuous on S if S is compact. 


с Show that is uniformly continuous оп 5 if S is compact and has no 
zeros in S. 


(d) Give examples showing that the conclusion of (b) and (c) may fail to hold 
if S is not compact. 

(e) State additional conditions on f and g which guarantee that fg is uniformly 
continuous on $ even if S is not compact. Do the same for f/g. 


Suppose that f is uniformly continuous on a set 5, g is uniformly continuous on a 
set T, and g(x) € S for every x in T. Show that f o g is uniformly continuous on 
T. 


(a) Prove: If f is uniformly continuous on disjoint closed intervals /1, Iz, ..., 
In, then f is uniformly continuous on U zi Ij. 


(b) Is (a) valid without the word “closed”? 


(a) Prove: If f is uniformly continuous on a bounded open interval (a, b), then 
f (a+) and f (b—) exist and are finite. HINT: See Exercise 2.1.38. 


(b) Show that the conclusion in (a) does not follow if (a, b) is unbounded. 


Prove: If f is continuous on [a, oo) and f (оо) exists (finite), then f is uniformly 
continuous on [a, оо). 


Suppose that f is defined on (—oo, oo) and has the following properties. 
(i) lim f(x) =1 and (ii) Хо) = f(xi)f (x2), —oo < xi, X2 < oo. 
х 


Prove: 


(a) f(x) > 0 for all x. 
(b) frx) = [f] ifr is rational. 
(c) If f(1) = 1 then f is constant. 
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(d) If f(1) = p> 1, then f is increasing, 
lim f(x) = oo, and lim f(x) = 0. 
х->со X——0o0 


(Thus, f(x) = е2 has these properties if a > 0.) 
HINT: See Exercises 2.2.10 and 2.2.12. 


34. Prove Theorem 2.2.14 in the case where f is nonincreasing. 


2.3 DIFFERENTIABLE FUNCTIONS OF ONE VARIABLE 


In calculus you studied differentiation, emphasizing rules for calculating derivatives. Here 
we consider the theoretical properties of differentiable functions. In doing this, we assume 
that you know how to differentiate elementary functions such as x", e*, and sin x, and we 
will use such functions in examples. 


Definition of the Derivative 


Definition 2.3.1 A function f is differentiable at an interior point xo of its domain if 
the difference quotient 
f(x) — f (xo) 


X — X0 


X Æ xg, 


approaches a limit as x approaches xo, in which case the limit is called the derivative of f 
at хо, and is denoted by f'(xo); thus, 


gites m OSA. (2.3.1) 
x—x0 X — Xo 
It is sometimes convenient to let x = хо + h and write (2.3.1) as 
| Xo th)— f(x 
Рн) = Yim, 0+ = Л) P 


If f is defined on an open set S, we say that f is differentiable on S if f is differentiable 
at every point of S. If f is differentiable on S, then f’ is a function on 5. We say that 
f is continuously differentiable on S if f’ is continuous on S. If f is differentiable on a 
neighborhood of хо, it is reasonable to ask if f’ is differentiable at xo. If so, we denote the 
derivative of f’ at xo by f" (хо). This is the second derivative of f at xo, and it is also 
denoted by fO (xg). Continuing inductively, if f~) is defined on a neighborhood of 
Xo, then the nth derivative of f at xo, denoted by f ? (xo), is the derivative of / "P at 
Xo. For convenience we define the zeroth derivative of f to be f itself; thus 


fo =f 


We assume that you are familiar with the other standard notations for derivatives; for 
example, 


qo = p ri = ght, 
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and so on, and 
d" f 
dx^ 


= pee. 


Example 2.3.1 If n is a positive integer and 


f(x) = x", 
then 
п—1 
f(x) – fo) _ х®—ху _ х—хо qa uk 
I Se стщ нн 0* 
X Хо X Хо X XO k=0 
SO 


п—1 
D : n—k—1 Jk n—l 
xo) = lim х ху —nXg . 
оо) = lim у, 0 —nx 
k=0 
Since this holds for every xo, we drop the subscript and write 


d 
РО) = nx"! or xe? = nx"! ш 


To derive differentiation formulas for elementary functions such as sin x, cos x, and e* 
directly from Definition 2.3.1 requires estimates based on the properties of these functions. 
Since this is done in calculus, we will not repeat it here. 


Interpretations of the Derivative 


If f(x) is the position of a particle at time x Æ xo, the difference quotient 


f(x) — f(xo) 


X — X0 


is the average velocity of the particle between times xo and x. As x approaches xo, the 
average applies to shorter and shorter intervals. Therefore, it makes sense to regard the limit 
(2.3.1), if it exists, as the particle's instantaneous velocity at time xo. This interpretation 
may be useful even if x is not time, so we often regard /'(хо) as the instantaneous rate of 
change of f (x) at xo, regardless of the specific nature of the variable x. The derivative also 
has a geometric interpretation. The equation of the line through two points (xo, f (xo)) and 
(x1, f (x1)) on the curve y = f(x) (Figure 2.3.1) is 


f (x1) = f (xo) 


X1 — Хо 


y = f(xo) + (x — xo). 


Varying xı generates lines through (xo, f (xo)) that rotate into the line 


y = f(xo) + f'(xo)(x — xo) (2.3.2) 
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as xı approaches хо. This is the tangent to the curve y = f(x) at the point (xo, f (xo)). 
Figure 2.3.2 depicts the situation for various values of хі. 


y 
A 


y=f@) 


з :== = =ы и иа ЫҢ 


=== а 


Figure 2.3.1 


Figure 2.3.2 


Here is a less intuitive definition of the tangent line: If the function 
T(x) = f(xo) + m(x — xo) 


approximates f so well near хо that 


km LOTTO) _ 
im ————— = 


х=) X — Xo 


0, 


we say that the line y = T(x) is tangent to the curve y = f(x) at (xo, f (xo)). 
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This tangent line exists if and only if (xo) exists, in which case т is uniquely determined 
by m = f'(xo) (Exercise 2.3.1). Thus, (2.3.2) is the equation of the tangent line. 


We will use the following lemma to study differentiable functions. 
Lemma 2.3.2 If f is differentiable at xo, then 
f(x) = fo) + [7 (xo) + EOE — xo). Q.3.3) 
where E is defined on a neighborhood of xo and 


lim E(x) = E(xo) = 0. 
X—X0 
Proof Define 


fœ- fo) y 
BAS raa BS R (2.3.4) 


0, X = Хо. 


Solving (2.3.4) for f(x) yields (2.3.3) if x # xo, and (2.3.3) is obvious if x = хо. Defini- 
tion 2.3.1 implies that lim,_,,, E(x) = 0. We defined E (x9) = 0 to make E continuous 
at Xo. ш 


Since the right side of (2.3.3) is continuous at x9, so is the left. This yields the following 
theorem. 


Theorem 2.3.3 If f is differentiable at xo, then f is continuous at хо. 


The converse of this theorem is false, since a function may be continuous at a point 
without being differentiable at the point. 


Example 2.3.2 The function 


f(x) = |х| 
can be written as 
I@= x, x0, (2.3.5) 
or as 
f(x)2-x, x«0. (2.3.6) 
From (2.3.5), 


о) = 1, x»0, 
and from (2.3.6), 
f'(x)2-1Ll x <0. 


Neither (2.3.5) nor (2.3.6) holds throughout any neighborhood of 0, so neither can be used 
alone to calculate f’(0). In fact, since the one-sided limits 


iO ee (2.3.7) 
x04 x—0 хэ0+ x 

and 
ju; CE au Е (2.3.8) 


x—0— x—0 x0— x 
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are different, 
i f(x) — f(0) 
im —————— 
x0 x—0 
does not exist (Theorem 2.1.6); thus, f is not differentiable at 0, even though it is continu- 
ous at 0. 


Interchanging Differentiation and Arithmetic Operations 
The following theorem should be familiar from calculus. 


Theorem 2.3.4 If апа g are differentiable at xo, then so are f +g, f —g,and fg, 
with 


(a) (7 + 8) (xo) = f'(xo) + 8’ (хо); 
(b) Cf — g)'(xo) = f'(xo) — (xo): 
(c) (78) (хо) = f'(xo)gGo) + f Gxo)g' (хо). 
The quotient f / g is differentiable at xo if g(xo) 4 0, with 
(d) (2 | а f '(xo)g(xo) — /(хо)8” (Xo). 
[g(xo)]” 
Proof The proof is accomplished by forming the appropriate difference quotients and 


applying Definition 2.3.1 and Theorem 2.1.4. We will prove (c) and leave the rest to you 
(Exercises 2.3.9, 2.3.10, and 2.3.11). 


The trick is to add and subtract the right quantity in the numerator of the difference 
quotient for ( fg)’ (хо); thus, 


fG)g(x) — (хо) (хо) faa) — fog) + fog) — fGxo)g(xo) 
X — X0 Е X — X0 


уура б) 


x= — X0 


The difference quotients on the right T f' (xo) and g'(xo) as x approaches xo, and 
тхо g(x) = g(xo) (Theorem 2.3.3). This proves (c). ш 


The Chain Rule 


Here is the rule for differentiating a composite function. 


Theorem 2.3.5 (The Chain Rule) Suppose that g is differentiable at xo and f 
is differentiable at g(xo). Then the composite function h — f o g, defined by 


A(x) = f(g(x)). 


is differentiable at xo, with 


h'(xo) = f'(g(xo))g (xo). 
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Proof Since f is differentiable at g(xo), Lemma 2.3.2 implies that 


FO — f(xo)) = L£'(g(xo)) + EO — go), 


where 
lim 50 = E(g(xo)) = 0. 


t—g(xo 


Letting t = g(x) yields 


FEE) — f(Gxo)) = [/'(в(хо)) + EEIE) — g(xo)I. 


Since h(x) = f(g(x)), this implies that 


POOO c ee ew ae 


X — X0 X — X0 


Since g is continuous at xo (Theorem 2.3.3), (2.3.9) and Theorem 2.2.7 imply that 


Jim E(gG)) = Elgo) = 0. 
Therefore, (2.3.10) implies that 
h(x) — h(xo) 


h'(xo) = lim = f'(g(xo))g' (xo). 
х->хо X — X0 
as stated. 


Example 2.3.3 If 


f(x) =sinx and g(x)= = x £0, 


then i 
h(x) = fü) = sini, x £0, 
and 
MG) = f'GoX)eQ) = (cos ~) (-3) 5% 


It may seem reasonable to justify the chain rule by writing 


h(x) —h(xo) | f(g(x)) — f((xo)) 


X — X0 X — X0 
_ SEW) бо) #(х) — 800) 
g(x) — g(xo) X — Xo 


and arguing that 
„ LEW) = SE) 


rcr SOM 


(2.3.9) 


(2.3.10) 
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(because іт,» g(x) = g(xo)) and 
lim 200-809) _ i). 
х->хо X — X0 


However, this is not a valid proof (Exercise 2.3.13). 


One-Sided Derivatives 


One-sided limits of difference quotients such as (2.3.7) and (2.3.8) in Example 2.3.2 are 
called one-sided or right- and left-hand derivatives. That is, if f is defined on [xo, 5), the 
right-hand derivative of f at xo is defined to be 


Fa- im 100-769) 
joe 


х—>хо+ X — X0 
if the limit exists, while if f is defined on (a, xo], the left-hand derivative of f at xo is 
defined to be 
fo) = tim 70076) 
X—X90— X — XQ 


if the limit exists. Theorem 2.1.6 implies that f is differentiable at xo if and only if f{ (xo) 
and f' (хо) exist and are equal, in which case 


f'(xo) = filo) = f! (xo). 
In Example 2.3.2, / (0) = 1 and f’(0) = —1. 


Example 2.3.4 If 


x?, x <0, 
f(x) = 1 (2.3.11) 
x?sincC, x» 0, 
then 
3x?, x <0, 
f'@) = 1 1 (2.3.12) 


2x sin — — cos —, x>0. 
x X 


Since neither formula in (2.3.11) holds for all x in any neighborhood of 0, we cannot simply 
differentiate either to obtain f’(0); instead, we calculate 


ae. 1 

x“ sin — —0 1 
/(0 = lim —*— = li in — = 0, 
f+) Fene? x —0 one 


3 
-0 
FLO = lim ~~ = lim x? — 0; 
x0— X — x—0— 


hence, f'(0) = 3; (0) = f'(0) = 0. a 
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This example shows that there is a difference between a one-sided derivative and a one- 
sided limit of a derivative, since f (0) = 0, but, from (2.3.12), f'(04-) = іт, o4. f'(x) 
does not exist. It also shows that a derivative may exist in a neighborhood of a point xo 
(= 0 in this case), but be discontinuous at хо. 


Exercise 2.3.4 justifies the method used in Example 2.3.4 to compute f'(x) for x Æ 0. 


Definition 2.3.6 


(a) We say that f is differentiable on the closed interval |a, b] if f is differentiable on 
the open interval (a,b) and f{ (a) and f" (b) both exist. 


(b) We say that f is continuously differentiable on [a,b] if f is differentiable on [a, b], 
f’ is continuous on (a, b), fi (a) = f'(a--), and f'(b) = f'(b—). 


Extreme Values 


We say that f (xo) is a local extreme value of f if there isa ё > 0 such that f(x) — f'(xo) 
does not change sign on 
(Xo — ô, xo + ô) N Dy. (2.3.13) 


More specifically, f (xo) is a local maximum value of f if 
f(x) € f(xo) (2.3.14) 


or a local minimum value of f if 


f(x) = fo) (2.3.15) 


for all x in the set (2.3.13). The point хо is called a local extreme point of f, or, more 
specifically, a local maximum or local minimum point of f . 


Figure 2.3.3 
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Example 2.3.5 If 


(Figure 2.3.3), then 0, 3, and every x in (—1, —3) are local minimum points of f , while 1, 
4, and every x in (—1, –1] аге local maximum points. ш 


It is geometrically plausible that if the curve у = f(x) has a tangent at a local extreme 
point of f, then the tangent must be horizontal; that is, have zero slope. (For example, in 
Figure 2.3.3, see х = 1, x = 3, and every x in (—1, —1/2).) The following theorem shows 
that this must be so. 


Theorem 2.3.7 If f is differentiable at a local extreme point xo є D9., then f'(xo) = 


Proof We will show that xo is not a local extreme point of f if f’(xo) 4 0. From 
Lemma 2.3.2, 
f(x) – f(xo) 
X — X0 


where limy_,x, E(x) = 0. Therefore, if f'(xo) 3 0, there isa 8 > 0 such that 


= f'(xo) + E(x), (2.3.16) 


|E(x)| «|f'(xo)) if |х хо « 6, 


and the right side of (2.3.16) must have the same sign as /'(хо) for |x — хо| < 6. Since 
the same is true of the left side, f(x) — f(xo) must change sign in every neighborhood of 
Xo (since x — xo does). Therefore, neither (2.3.14) nor (2.3.15) can hold for all x in any 
interval about хо. ш 


If (хо) = 0, we say that xo is a critical point of f. Theorem 2.3.7 says that every 
local extreme point of f at which f is differentiable is a critical point of f. The converse 
is false. For example, 0 is a critical point of f(x) = x3, but not a local extreme point. 


Rolle’s Theorem 


The use of Theorem 2.3.7 for finding local extreme points is covered in calculus, so we will 
not pursue it here. However, we will use Theorem 2.3.7 to prove the following fundamental 
theorem, which says that if a curve y = f(x) intersects a horizontal line at x = a and 
x = b and has a tangent at (x, f(x)) for every x in (a, b), then there is a point c in (a, b) 
such that the tangent to the curve at (c, f(c)) is horizontal (Figure 2.3.4). 


> 
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y 


> x 


Figure 2.3.4 


Theorem 2.3.8 (Rolle’s Theorem) Suppose that f is continuous on the closed 
interval [a, b] and differentiable on the open interval (a,b), and f(a) = f(b). Then 
f' (c) = 0 for some c in the open interval (a, b). 


Proof Since f is continuous on [a, b], f attains a maximum and a minimum value on 
[а,Ь] (Theorem 2.2.9). If these two extreme values are the same, then f is constant on 
(a, b), so f'(x) = 0 for all x in (a, b). If the extreme values differ, then at least one must 
be attained at some point c in the open interval (a, b), and f'(c) = 0, by Theorem 2.3.7. 
ш 


Intermediate Values of Derivatives 


A derivative may exist on an interval [a, b] without being continuous on [a, b]. Neverthe- 
less, an intermediate value theorem similar to Theorem 2.2.10 applies to derivatives. 


Theorem 2.3.9 (Intermediate Value Theorem for Derivatives) Suppose 


that f is differentiable on |a, b], f'(a) # f'(b), and u is between f'(a) and f'(b). Then 
f'(c) = u for some c in (a, Б). 


Proof Suppose first that 


f'(a) <и « f'(b) (2.3.17) 
and define 
g(x) = fx) - ux. 
Then 
(х) = (0) - и, asx<b, (2.3.18) 
and (2.3.17) implies that 
g(a)«0 and g'(b)>0. (2.3.19) 


Since g is continuous on [a, b], g attains a minimum at some point c in [a, b]. Lemma 2.3.2 
and (2.3.19) imply that there is a ô > 0 such that 


g(x) < g(a), a<x<a+é, and g(x) < (0), b—-ó«x«b 
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(Exercise 2.3.3), and therefore с zz a and c ZZ b. Hence, a < c < b, and therefore 
£ (c) = 0, by Theorem 2.3.7. From (2.3.18), f'(c) = p. 


The proof for the case where f’(b) < u < f'(a) can be obtained by applying this result 
to — f. a 


Mean Value Theorems 


Theorem 2.3.10 (Generalized Mean Value Theorem) /f f and g are con- 
tinuous on the closed interval [a, b] and differentiable on the open interval (a, b), then 


[g(b) — g(a)].£ (c) = [/@) — f(a)]g (с) (2.3.20) 


for some c in (a, b). 
Proof The function 


A(x) = [g(b) — g(a)] f(x) — Lf (5) — f(a)]gQx) 


is continuous on [a, b] and differentiable on (a, b), and 


h(a) = h(b) = g(b) f (a) — f (b)g(a). 


Therefore, Rolle's theorem implies that A'(c) = 0 for some c in (a, b). Since 


h'(c) = [g(5) — g(a)] 7 (с) — [/(5) – /(а)]в (с), 
this implies (2.3.20). [| 


The following special case of Theorem 2.3.10 is important enough to be stated separately. 


Theorem 2.3.11 (Mean Value Theorem) /f f is continuous on the closed 
interval [а, b] and differentiable on the open interval (a, b), then 
b) — f(a) 
—a 


for some c in (a, b). 


Proof Apply Theorem 2.3.10 with g(x) — x. 


Theorem 2.3.11 implies that the tangent to the curve y = f(x) at (c, f(c)) is parallel to 
the line connecting the points (a, f(a)) and (b, f (b)) on the curve (Figure 2.3.5, page 84). 


Consequences of the Mean Value Theorem 


If f is differentiable on (a, b) and x1, x2 € (a,b) then f is continuous on the closed 
interval with endpoints x; and x» and differentiable on its interior. Hence, the mean value 
theorem implies that 

fœ) = Роп) = /'(с)(хә — x1) 
for some c between x, and хә. (This is true whether x; < x2 or x2 < хі.) The next three 
theorems follow from this. 
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Theorem 2.3.12 If f'(x) = 0 forall x in (a, b), then f is constant on (a, b). 


Theorem 2.3.13 If f’ exists and does not change sign on (a, b), then f is monotonic 
on (a, b) : increasing, nondecreasing, decreasing, or nonincreasing as 


f'x)-0, f'G)z0, f'x)«0, or f(x) <0, 


respectively, for all x in (a, b). 


Theorem 2.3.14 If 
If£/G) <M, a«x«b, 


then 
If) - fx») < Mix -x'|, х, х’ € (а,Ь). (2.3.21) 


A function that satisfies an inequality like (2.3.21) for all x and x' in an interval is said 
to satisfy a Lipschitz condition on the interval. 
y 
A 


РФ) y-fQ) 


fo) 


f(a) 


Figure 2.3.5 


2.3 Exercises 


1. Prove that a function f is differentiable at xo if and only if 


im LO T бо) = mlx = x0) _ 
1 = 


x—> xo X — Xo 


0 


for some constant т. In this case, /'(хо) = m. 
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Prove: If f is defined on a neighborhood of xo, then f is differentiable at хо if and 
only if the discontinuity of 


_ fe) = f Go) 


X — X0 


h(x) 


at xo is removable. 


Use Lemma 2.3.2 to prove that if /'(хо) > 0, there is a 8 > 0 such that 


f(x) < f(xo)if xo—ó «x < xo and f(x) > f(xo)if xo <x < xo + ô. 


Suppose that p is continuous on (a, c] and differentiable on (a, c), while q is con- 
tinuous on [c, b) and differentiable on (c, b). Let 


р(х), а<х<с, 


fe | 


q(x), c«x«b. 


(a) Show that 
p(x), a«x«c, 


q(x, c«x«b. 

(b) Under what additional conditions on p and q does f'(c) exist? Prove that 
your stated conditions are necessary and sufficient. 

Find all derivatives of f(x) = x"! |х|, where n is a positive integer. 


Suppose that f’(0) exists and f(x + y) = f(x) f(y) for all x and y. Prove that f’ 
exists for all x. 


Suppose that c’(0) = a апа s’(0) = b where a? + b? 5 0, and 


c(x + y) = с(х)с(у) — s(@x)s(y) 
s(x + y) = s(x)cQ) + с(х)5(у) 


for all x and y. 


(a) Show that c and s are differentiable on (—oo, oo), and find c' and s' in terms 
of c, s, a, and b. 
(b) (For those who have studied differential equations.) Find c and s explicitly. 


(a) Suppose that f and g are differentiable at xo, f(xo) = g(xo) = 0, and 
£ (xo) = 0. Without using L'Hospital's rule, show that 
Ло) бо) 
xoxo g(x) — g'(xo) 


(b) State the corresponding results for one-sided limits. 
Prove Theorem 2.3.4(a). 
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10. 
11. 
12. 


13. 


14. 


15. 


16. 


17. 


18. 


19. 
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Prove Theorem 2.3.4(b). 
Prove Theorem 2.3.4(d). 
Prove by induction: Ifn > 1 and f ™® (xo) and g™ (хо) exist, then so does (fg) (хо), 
and 
” fn 
( fg)? (хо) = 5 | ) SO yao m (хо). 
т 
т=0 
HINT: See Exercise 1.2.19. This is Leibniz’s rule for differentiating a product. 


What is wrong with the “proof” of the chain rule suggested after Example 2.3.3? 
Correct it. 


Suppose that f is continuous and increasing on [a, b]. Let f be differentiable at a 

point хо in (a, b), with f'(xo) z 0. If g is the inverse of f Theorem 2.2.15), show 

that g'(f(xo)) = 1/7 (xo). 

(a) Show that / (a) = f'(a4-) if both quantities exist. 

(b) Example 2.3.4 shows that f' (a) may exist even if f’(a+) does not. Give an 
example where f’(a+) exists but fi (a) does not. 

(c) Complete the following statement so it becomes a theorem, and prove the 
theorem: "If f’(a+) exists and f is_____at a, then fi (а) = f"(a+).” 

Show that f(a+) and f(b—) exist (finite) if f’ is bounded on (a,b). HINT: See 

Exercise 2.1.38. 

Suppose that f is continuous on [a, b], f (a) exists, and u is between f, (a) and 

(f(b) — f(a))/(b — a). Show that f(c) — f(a) = u(c — a) for some c in (a,b). 

Suppose that f is continuous on [a,b], / (a) < u < f'! (b), and 


Cf (b) — f(a))/(b — a) # p. 


Show that either f(c) — f(a) = u(c — a) ог (с) — f(b) = u(c — b) forsomec 
in (a, b). 
Let . 

sinx 


fœ) = > x #0. 


x 


(a) Define f(0) so that f is continuous at x = 0. HINT: Use Exercise 2.3.8. 
(b) Show that if x is a local extreme point of f, then 


|f&G)] = @-+ ху! 


HINT: Express sinx and cos x in terms of f(x) апа f'(x), and add their 
squares to obtain a useful identity. 


(c) Show that | f(x)| < 1 for all x. For what value of x is equality attained? 


20. 


21. 


22. 


23. 


24. 


25. 
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Let п be a positive integer and 


f(x) = . ——, x km (К = integer). 


(a) Define f (kz) so that f is continuous at Кт. HINT: Use Exercise 2.3.8. 
(b) Show that if x is a local extreme point of f, then 


Lf] = [1 + 2 зае", 


HINT: Express sinnx and cosnx in terms of f(x) and f'(x), and add their 
squares to obtain a useful identity. 
(c) Show that | f(x)| < 1 for all x. For what values of x is equality attained? 


We say that f has at least n zeros, counting multiplicities, on an interval J if there 
are distinct points x1, X2, ..., Xp in J such that 


fW(x)20, O< j<nj—-1, 1<i<p, 


and n; 4: d ny = n. Prove: If f is differentiable and has at least n zeros, 
counting multiplicities, on an interval J, then f" has at least n — 1 zeros, counting 
multiplicities, on Z. 


Give an example of a function f such that f’ exists on an interval (a, b) and has a 
jump discontinuity at a point xo in (a, b), or show that there is no such function. 


Let x1, X2, ..., Xn and у, yo, ..., Yn be in (a, b) and yj < xi, 1 € i € n. Show 
that if f is differentiable on (a, b), then 


Уо) - fod] = ft) Y ei - у) 
і=1 і=1 
for some с in (а, Ё). 


Prove or give a counterexample: If f is differentiable on а neighborhood of хо, then 
f satisfies a Lipschitz condition on some neighborhood of xo. 


Let 
Sf" (x) + p(x)f(x) and g"(x) + pG)g(x) 20, a«x«b. 


(a) Show that W = f'g — fg’ is constant on (a, b). 


(b) Prove: If W Æ бапа f(x1) = f(x2) = 0 where a < xı < хә < b, then 
g(c) = 0 for some c in (x1, x2). HINT: Consider f/g. 
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26. Suppose that we extend the definition of differentiability by saying that f is differ- 


entiable at xo if 
f(x) — fo) 
x—xo X — X9 
exists in the extended reals. Show that if 


мх, х > 0, 


fœ) = OJ, х0, 
then /'(0) = oo. 
27. Prove or give a counterexample: If f is differentiable at хо in the extended sense of 
Exercise 2.3.26, then f is continuous at хо. 
28. Assume that f is differentiable on (—оо, oo) and xo is a critical point of f. 


(a) Let h(x) = f(x)g(x), where g is differentiable on (—oo, oo) and 
f Gxo)g' (xo) z 0. 


Show that the tangent line to the curve y = h(x) at (xo, A(xo)) and the tangent 
line to the curve y = g(x) at (xo, g(xo) intersect on the x-axis. 

(b) Suppose that f(xo) z 0. Let h(x) = f(x)(x — x1), where x; is arbitrary. 
Show that the tangent line to the curve y = h(x) at (xo, A(xo)) intersects the 
X-axis at X = х. 

(c) Suppose that f(xo) 3 0. Let h(x) = f(x)(x — x1)?, where x1 Æ xo. Show 
that the tangent line to the curve y = h(x) at (xo, h(xo)) intersects the x-axis 
at the midpoint of the interval with endpoints xo and хі. 

(d) Let h(x) = (ax? + bx +c)(x — x1), where a Æ 0 and b? — 4ac F 0. Let 
хо = E. Show that the tangent line to the curve y = h(x) at (xo, h(xo)) 

а 
intersects the x-axis at X = х]. 

(e) Let bea cubic polynomial with zeros о, P, and y, where о and В are distinct 

and y is real. Let хо = ETE Show that the tangent line to the curve 


y — h(x) at (xo, h(xo)) intersects the axis at X — y. 
2.4 L'HOSPITAL'S RULE 


The method of Theorem 2.1.4 for finding limits of the sum, difference, product, and quo- 
tient of functions breaks down in connection with indeterminate forms. The generalized 
mean value theorem (Theorem 2.3.10) leads to a method for evaluating limits of indetermi- 
nate forms. 


Theorem 2.4.1 (L'Hospital's Rule) Suppose that f and g are differentiable 
and g' has no zeros on (a, b). Let 


lim f(x) = lim g(x) = 0 (2.4.1) 
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or 
lim f(x) = +оо and lim g(x) = +оо, (2.4.2) 
x—>b— x—>b— 
and suppose that 
/ 
ар ferid. (2.4.3) 
x—b— g'(x) 
Then 
lim JG) =L (2.4.4) 
x>b— g(x) 


Proof We prove the theorem for finite L and leave the case where L = +оо to you 
(Exercise 2.4.1). 


Suppose that € > 0. From (2.4.3), there is an xg in (a, b) such that 


f'(c) 


-L 
g'(c) 


«e if хо<с <. (2.4.5) 


Theorem 2.3.10 implies that if x and ¢ are in [xo, b), then there is a c between them, and 
therefore in (xo, Б), such that 


[g(x) — £(0]/ (c) = Lf) — fg (с). (2.4.6) 


Since g' has no zeros in (a, b), Theorem 2.3.11 implies that 


g(x)-—g(t) ZO if x.te€ (a,b). 


This means that g cannot have more than one zero in (a, b). Therefore, we can choose хо 
so that, in addition to (2.4.5), g has no zeros in [xo, b). Then (2.4.6) can be rewritten as 


fw- f" 
8(х) – 20) — (c) 
so (2.4.5) implies that 


fŒ- 


E L| <e if x,t € [xo b). (2.4.7) 


If (2.4.1) holds, let x be fixed in [xo, b), and consider the function 


feo = fü) 
GA = = -L 
(0 = 0) 80) 
From (2.4.1), 
к /@) = I g(t) — 0, 
SO 


fe) 
g(x) j 


lim G(t) = (2.4.8) 
t>b- 
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Since 
IG(t)|<e if xo«t «b, 


because of (2.4.7), (2.4.8) implies that 


This holds for all x in (xo, b), which implies (2.4.4). 


The proof under assumption (2.4.2) is more complicated. Again choose хо so that (2.4.5) 
holds and g has no zeros in [xo, b). Letting tf = xo in (2.4.7), we see that 


f(x) — оа) _ 
g(x) — (хо) 


Since lim,_,,— f(x) = +оо, we can choose xı > xo so that f(x) Z Oand f(x) Æ f(xo) 
if x1 < x « b. Then the function 


L 


«ec if x9 xx«b. (2.4.9) 


1 — g(xo)/g(x) 
1 — f(xo)/ f(x) 


is defined and nonzero if x, < x < b, and 


u(x) = 


lim u(x) = 1, (2.4.10) 


xb— 
because of (2.4.2). 
Since 
F(x) = fx) _ fŒ) 1—f(xo/f(x) _ fQ) 
g£x)—8(xo ga) 1—8Go)/2() goua)’ 
(2.4.9) implies that 


Lh<e if x«x«b, 


| fe 
g(x)u(x) 
which can be rewritten as 
f(x) 
g(x) 
From this and the triangle inequality, 

fe) В <|/® 

g(x) g(x) 
Because of (2.4.10), there is a point x2 in (x1, b) such that 


—Lu(x) <elu(x)| if x1<x <b. (2.4.11) 


+ |Lu(x) — L| < €lu(x)| 4-|L||u(x) — 1]. (2.4.12) 


— Lu(x) 


lu(x) — Ц «e andtherefore |и(х)| <1+є if x2<x <b. 
This, (2.4.11), and (2.4.12) imply that 


f(x) 
g(x) 


= Г 


<є(1+6 + |Шє if х <х «b, 
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which proves (2.4.4) under assumption (2.4.2). E 


Theorem 2.4.1 and the proof given here remain valid if b = oo and “x — b—” is 
replaced by “x — oo" throughout. Only minor changes in the proof are required to show 
that similar theorems are valid for limits from the right, limits at —oo, and ordinary (two- 
sided) limits. We will take these as given. 


The Indeterminate Forms 0/0 and оо/оо 
We say that f/g is of the form 0/0 as x — b— if 
lim f(x) = lim g(x) = 0, 
x—b— xb— 
or of the form oo/oo as x — b— if 
lim f(x) = +00 
x—b— 


and 
lim g(x) = +оо. 
xb— 
The corresponding definitions for x — b+ and x — +œ are similar. If f/g is of one of 


these forms as x — b— and as x — b+, then we say that it is of that form as x — b. 


Example 2.4.1 The ratio sin х/х is of the form 0/0 as x — 0, and L'Hospital's rule 
yields 


Example 2.4.2 The ratio e * /x is of the form 00/00 as x — —oo, and L'Hospital's 
rule yields 
e* —x 
lim — = lim 
x—-—o0 X X—-—oo 


Example 2.4.3 Using L'Hospital's rule may lead to another indeterminate form; thus, 


e* e* 


lim — = lim — 
x—oo x2 x> 2x 


if the limit on the right exists in the extended reals. Applying L’ Hospital's rule again yields 


e* . e* 
lim — = lim — =o. 
x—0oo 2x x—oo 2 
Therefore, 
x 
. e 
lim — — oo 
хоо х2 
More generally, 
e* 
m — = oo 
x—oo х 


for any real number o (Exercise 2.4.33). 
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Example 2.4.4 Sometimes it pays to combine L’Hospital’s rule with other manipula- 
tions. For example, 


. 4—4cosx —2sin? x . 4sinx —4sinx cos x 
lim Ecc = "==" дыл = 
x0 X x0 4x 


. sinx . l—-cosx 
lim lim ———— 
x0 Xx x20 х2 

. Sinx . Sinx 
— | lim lim 
x0 x x0 2x 


[ 


1 1 
= 20 = 5 (Example 24.1). 


As another example, L'Hospital's rule yields 


lim ет? log( + x) — lim —2xe log(1 + х) + er (1 +x)! 
x0 x x0 1 


= 1. 


However, it is better to remove the “determinate” part of the ratio before using L’ Hospital’s 


rule: 
. ex log(14- x) : E . log(l 4 x) 
lim ————————— = | lime lim ————— 


x0 X х x0 X 
log(1 + 
x0 X 
1/(1 
x0 1 
In using L' Hospitals rule we usually write, for example, 
/ 
ш NE PO (2.4.13) 


x>b g(x) хәһ g'(x) 


and then try to find the limit on the right. This is convenient, but technically incorrect, since 
(2.4.13) is true only if the limit on the right exists in the extended reals. It may happen that 
the limit on the left exists but the one on the right does not. In this case, (2.4.13) is incorrect. 


Example 2.4.5 If 
1 
f(x)2x-x?sin- and g(x) =sinx, 
x 


then 


1 1 
f'(x)21-2x sin = + cos m and g'(x) — cosx. 
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Therefore, lim, 9 f’(x)/g’ (x) does not exist. However, 


. f(x) . l-xsin(l/x) 1 
lim = lim ==]. 
x0 g(x) x20  (sinx)/x 1 


The Indeterminate Form 0 · оо 


We say that a product fg is of the form 0 - oo as x — b— if one of the factors approaches 
0 and the other approaches +оо as x — b—. In this case, it may be useful to apply 
L'Hospital's rule after writing 


f(x) g(x) 
1/g(x) 1/f(x)' 


since one of these ratios is of the form 0/0 and the other is of the form оо/оо as x > b-. 


fG)gx) = or f(x)g(x) = 


Similar statements apply to limits as х — b+, x — b, and x — +оо. 


Example 2.4.6 The product x log x is of the form 0. oo as x — 0+. Converting it to 
an оо/оо form yields 


lim xlogx= lim -98* 
ad ов» тй сүр 1/х 
mE 1/x 
ges —1/x? 
—— lim x=0. 
x—04- 


Converting to a 0/0 form leads to a more complicated problem: 


x 
li 1 = lim —— 
Pa a MEN esa 1/logx 
li : 

= lim ———___. 

x204 —1/x (log x)? 


—- li logx)? =? 
eee 


Example 2.4.7 The product x log(1+1/.x) is of the form 0-00 as x — oo. Converting 
it to a 0/0 form yields 


log(1 4- 1 
lim xlog( + 1/x) = lim log) 
хоо хоо 1/х 


qu, WOE VY) 
^ x00 —1/x? 
1 


= lim ——— = 1 
x00 1+ 1/x 
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In this case, converting to an oo/oo form complicates the problem: 
lim xlog(1--1/x)- li ~ 
im xlo x)= lim ———————— 
хоо e x—oo 1/log(1 + 1/x) 


. 1 
= lim 


= lim x(x + 1)ог(1 + 1/x)? =? 


The Indeterminate Form oo — оо 


A difference f — g is of the form oo — co as x — b— if 
lim f(x) = lim g(x) = +оо. 
x—>b— x—>b— 
In this case, it may be possible to manipulate f — g into an expression that is no longer 
indeterminate, ог is of the form 0/0 or оо/оо as x — b—. Similar remarks apply to limits 


asx > b+, x > b, or x > coo. 


Example 2.4.8 The difference 


is of the form oo — oo as x — 0, but it can be rewritten as the 0/0 form 


sinx—x 
x2 ^7 
Hence, 
. sin x 1 . Sinx—x . cosx-]1 
lim ——|= lim = lim 
x0 x? X x0 X x0 2x 
. —sinx 
— lim = 0. 
x0 2 
Example 2.4.9 The difference 
х?—х 


is of the form оо — oo as х — оо. Rewriting it as 


1 
e 
x 
which is no longer indeterminate as x — oo, we find that 
: 2 : 2 1 
lim (x^ —x) = lim x^[1—— 
X—o00 х->со x 


f a\ г» 1 
= (Jim x?) lim 1—— 
X—00 хоо x 


= (00)(1) = оо 
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The Indeterminate Forms 0°, 1°, and оо? 
The function f£ is defined by 
SAO = ев 98709 = exp(g(x) log f(x) 
for all x such that f(x) > 0. Therefore, if f and g are defined and f(x) > 0 on an interval 


(a, b), Exercise 2.2.22 implies that 


lim [f/ G9]? = exp ( lim g(x)log £e») (2.4.14) 


if lim, 5р g(x) log f(x) exists in the extended reals. (If this limit is Eoo then (2.4.14) is 
valid if we define e ?? = 0 and e^? = co.) The product g log f can be of the form 0 - oo 
in three ways as x — b—: 


(a) flims- g(x) = 0 and іт, 5р f(x) = 0. 
(b) жнт, 5. g(x) = +оо and lim,_,,- f(x) = 1. 
(c) Iflim,+s- g(x) = 0 and іт, 5р f(x) = oo. 


In these three cases, we say that f£ is of the form 0°, 1°, and ооо, respectively, as х > 
b—. Similar definitions apply to limits as x > b+, x — b, and x — +оо. 


Example 2.4.10 The function x” is of the form 0° as x > 0+. Since 
x xlogx 


X =e 


and іт; »о+ x log x = 0 (Example 2.4.6), 


Example 2.4.11 The function x!/@— is of the form 1% as x — 1. Since 


a ped) — cep ( aan 
х—1 


апа 

1 1 
а а 
хэ1 х= 1 x>1 1 


it follows that 


lim x!/&-D =e! =e. 
x1 


0 


Example 2.4.12 The function x!/* is of the form oo? as x — oo. Since 


1 
xU* ew( sS) 
X 


1 
lim =й шй 
x00 x x—oco | 


and 
log x 
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it follows that 


lim x!/* =e? = 1. 
A-—hOQO 


2.4 Exercises 


1. Prove Theorem 2.4.1 for the case where limp- f’(x)/g'(x) = +оо. 


In Exercises 2.4.2—2.4.40, find the indicated limits. 


P B. quc _ _^ d. mo 
2. lim tan x ' o x20 log(1 4- x2) i x ex —] 
x90 sin ! x 
5. lim sinnx 6. lim log(1 + x) 7T duc une 
xz sinx x0 x enne 
8. lim xsin(1/x) 9. lim ate Mt —1) 10. lim tanxlogx 
x—oo X00 x04 
1 
. lim si 12. li — + log(t 
11 lim sin x log(| tan x|) Jim | + log( an x)| 
14. li : : 
13. lim (Vx +1 — Vx) алат Е 
: : 1 1 
15. Піт (cot. x — csc x) 16. lim | —— = – 
x0 x0NSsIn X x 
17. lim | sinx|""* 18. Пт |ќапх]|%* 
хл x—mz/2 
19. lim |sinx|* 20. lim(1 + x)!/* 
x0 x0 
x 2 
i sin(1 22. li — – — 
21. Jim x dd tim (= =) 
log(log x 
23. lim x*logx 24. m TEEN 
x—>0+ x>e sin(x — e) 
4 x2—1 JV x2—1 
1 1 
25. lim (+ 26. іт (2 
хоо \ х = ] x>1+\x-1 
B 
27. lim oes 28. lim (cosh x — sinh x) 
хоо x хоо 


: ON" 
29. lim (x^ — log x) 30. lim e" sin(e*) 
х->со 


31. 


33. 


35. 


37. 


38. 


39. 


40. 
41. 


42. 


43. 
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. sinx —x + x3/6 
lim x(x + 1) [log + 1/x)? 82. lim ————-——_ 
хоо 


x0 x5 
ex 34. lim е cosx 
im = x3z/2— 
x> X 
x* 
| а 36. lim 
gate (log x)" log(log x) x> x log x 
lim (sin x)""* 
x—z/2 
n 
ех — у, x'r! 
lim i (n = integer > 1) 
x0 xt 
n x2r*1 
sinx — DI 
2 ) (Qr + 1)! 
jig uem to e 
-1/x? 
lim —0 (п = integer) 


x0 x" 


(a) Prove: If f is continuous at xo and іт» f(x) exists, then f (xo) exists 


and f' is continuous at xo. 


(b) Give an example to show that it is necessary to assume in (a) that f is con- 


tinuous at xo. 
The iterated logarithms are defined by Lo(x) — x and 
Ln(x) = log(Ln-1(X)), х>аһ, n=l, 
where a, = 0 and а, = ейп-!, n > 1. Show that 
(а) 1һ(х)= 1м-1(Чорх), x>an, п>1. 
(b) Ln-1(an+) = 0 and Ly (an+) = —оо. 
(c) lim (Да-а (х) Ln () = 0 ifo > Oand n > 1. 
хап 
(d) lim (Ln(x))*/Ln—1(x) = 0 if o is arbitrary and n > 1. 
х->со 
Let f be positive and differentiable on (0, со), and suppose that 
ae 
хоо f(x) 
Define fo(x) — x and 


= L, where O«L < оо. 


Љ(х) = f (fax), nzl. 
Use L'Hospital's rule to show that 


iu 
im 


=з = if a>O and n=l. 
x—oo fn (x) 
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4A. Let f be differentiable on some deleted neighborhood N of xo, and suppose that f 
and f’ have no zeros іп N. Find 


(a) lim | f(x)|7 if lim f(x) = 0; 
x—xQ0 X x0 

(b) lim | f (x)| / 97? if lim f(x) = 1; 
x—xo х xo 

(c) im | f(x) iflimy ss, f(x) = oo. 


45. Suppose that f and g are differentiable and g’ has no zeros on (a, b). Suppose also 
that іт р f'(x)/g' (x) = L and either 


lim f(x) = lim g(x) = 0 
x—>b— x—>b— 


or 
lim /(х) = оо and lim g(x) = +оо. 
x—b— x—b— 


Find limy- (1 + faw. 


46. We distinguish between со. oo (= oo) and (—оо)оо (= —oo) and between oo + оо 
(= оо) and —oo — оо (= —oo). Why don't we distinguish between 0 - oo and 
0 - (—oo), оо — оо and —oo + оо, оо/оо and —oo/oo, and 1° and 17%? 


2.5 TAYLOR’S THEOREM 


A polynomial is a function of the form 
р(х) = ao + а(х — xo) t: + an (x — хо)", (2.5.1) 


where do, ..., аһ and xo are constants. Since it is easy to calculate the values of a polyno- 
mial, considerable effort has been devoted to using them to approximate more complicated 
functions. Taylor's theorem is one of the oldest and most important results on this question. 


The polynomial (2.5.1) is said to be written in powers of x — xo, and is of degree n if 
an # 0. If we wish to leave open the possibility that a, = 0, we say that p is of degree 
< n. In particular, a constant polynomial p(x) = do is of degree zero if ао # 0. If 
ао = 0, so that p vanishes identically, then p has no degree according to our definition, 
which requires at least one coefficient to be nonzero. For convenience we say that the 
identically zero polynomial p has degree —oo. (Any negative number would do as well as 
—oo. The point is that with this convention, the statement that p is a polynomial of degree 
< n includes the possibility that p is identically zero.) 


Taylor Polynomials 


We saw in Lemma 2.3.2 that if f is differentiable at xo, then 


f(x) = fo) + f'(xo)(x — хо) + E(x)(x — хо), 
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where 
lim E(x) = 0. 
X— X0 
To generalize this result, we first restate it: the polynomial 
Ti (x) = f(xo) + f'Gxo)(x — xo). 
which is of degree < | and satisfies 
Ti(xo) = (х0), Tio) = f'(xo). 
approximates f so well near xo that 


.. Го) Т(х) | 
m a = 


X>X0 X — Xo 


0. (2.5.2) 


Now suppose that f has n derivatives at xo and Т, is the polynomial of degree < n 
such that 
То) = f(x, 0xrzn. (2.5.3) 


How well does Т, approximate f near хо? 


To answer this question, we must first find Ta. Since 7, is a polynomial of degree < n, 
it can be written as 


Ta (x) = ao + ay (x — xo) + +++ + an(x — хо)", (2.5.4) 
where ao, ..., аһ are constants. Differentiating (2.5.4) yields 
T? (xy) —rla,, O<r<n, 


so (2.5.3) determines a, uniquely as 


ar = FOC) < r < n. 
r! 
Therefore, 
/ (n) 
Tal) f) + LO — x9) + TEL xy 


ы. (r) 
=F LOCI Gy. 
r=0 j 


We call Т, the nth Taylor polynomial of f about хо. 


The following theorem describes how Т, approximates f near xo. 


Theorem 2.5.1 If f™ (xo) exists for some integer n > 1 and Т, is the nth Taylor 
polynomial of f about xo, then 


хэхо (x — xo)” 
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Proof The proof is by induction. Let Р, be the assertion of the theorem. From (2.5.2) 
we know that (2.5.5) is true if n = 1; that is, Pı is true. Now suppose that P; is true for 
some integer n > 1, and / ("+1 exists. Since the ratio 


f) – Tri (X) 


(x = xo)”t! 
is indeterminate of the form 0/0 as x — xo, L Hospital ’s rule implies that 
— T, 1 (х) — T/ (x 
lim f(x) п+1 (х) E hn f (x) ard ) (2.5.6) 
xoxo (х — Xo)? t+! n+1x>x0 — (x— xo)” 


if the limit on the right exists. But f’ has an nth derivative at xo, and 


7 (r+1) 
у / en) T 


r=0 


Тоа (х) = — xo)” 


is the nth Taylor polynomial of f’ about xo. Therefore, the induction assumption, applied 
to f’, implies that 
РО) = Thai @) 
lim —————————— = 
x—xo (x — xg)" 


0. 


This and (2.5.6) imply that 
F(X) = Tne) _ 
m ——————— = 0 
xoxo (х — xo)” t! 
which completes the induction. ш 


It can be shown (Exercise 2.5.8) that if 
Pn = ао + а(х — xo) +++ + an (x — хо)" 


is a polynomial of degree < n such that 


Eni f(x) — pa (x) =0, 


x—xo (x ЕЕ хо)" 


еп 
f (xo). 
атш. 
that is, p, = Ty. Thus, Т, is the only polynomial of degree < n that approximates f near 
Xo in the manner indicated in (2.5.5). 


ar 


Theorem 2.5.1 can be restated as a generalization of Lemma 2.3.2. 


Lemma 2.5.2 If f (xo) exists, then 
n (r) 
f(x) = у, СЫ 01И — хо)" + En(x)(x — xo)", (2.5.7) 
г=0 4, 


where 
lim E,(x) = Е„(хо) = 0. 
X— X0 
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Proof Define 


F(x) — Tn(x) 
En(x) = (х= хо)" ' 
0, X = Xo. 


хє Dy — {xo}, 


Then (2.5.5) implies that limx—>xọ En(x) = Е, (хо) = 0, and it is straightforward to verify 
(2.5.7). ш 


Example 2.5.1 If f(x) = ех, then f(x) = e*. Therefore, f™(0) = 1 forn > 0, 
so the nth Taylor polynomial of f about хо = 0 is 


n r 2 п 


x x. 3X x 
Dec» cedo puo Е (2.5.8) 
r=0 
Theorem 2.5.1 implies that 
п r 
еу. 
— г! 
lim = = 0 
x0 x" 


(See also Exercise 2.4.38.) 


Example 2.5.2 If f(x) = logx, then f(1) = 0 and 


ggep МЫ „ың 


x" 
so the nth Taylor polynomial of f about xo — 1 is 
n 


еу c9 wear 


r 


r=1 


if n > 1. (То = 0.) Theorem 2.5.1 implies that 


log x — x. i-r 1)” 


ime — >1. 
x>] @— 1 my IBS 


Example 2.5.3 If f(x) = (1 + х), then 


f(x) = 40 tx) 
f(x) = 4(- DU ++ х)? 


f(x) = q(a-1)---(q—n- D + х)". 
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()-: and (7) - 8-9». "m 
0 n n! 

fOO _ fa 

n! — dap 


and the nth Taylor polynomial of f about 0 can be written as 


T. (x) = У) „Ж (2.5.9) 


r=0 


If we define 


then 


Theorem 2.5.1 implies that 


n 
(1+ х) – У. (> 
lim ONE 
x0 x? 


=0, n>0. [| 


If q is a nonnegative integer, then d is the binomial coefficient defined in Exer- 
n 
cise 1.2.19. In this case, we see from (2.5.9) that 


Т„(х) = (1+ х) = f(x), nq. 


Applications to Finding Local Extrema 
Lemma 2.5.2 yields the following theorem. 


Theorem 2.5.3 Suppose that f has n derivatives at хо and n is the smallest positive 
integer such that f (xo) 0. 


(a) Ifn is odd, xo is not a local extreme point of f. 

(b) Ifn is even, xo isa local maximum of f if Р (xo) < 0, or a local mininum of f if 
f €? (xg) > 0. 

Proof Since f ^? (xo) = 0 for 1 < r < n — 1, (2.5.7) implies that 


(n) 
I(x) — f(xo) = | + En w| (x = xo)” (2.5.10) 


in some interval containing хо. Since liMmx—>xọ En(x) = 0 and f? (xg) Æ 0, there isa 
ó > O such that 


|En(x)| < 


n 


if |x — xo| < ô. 


f (xg) 
! 
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This and (2.5.10) imply that 
f(x) = f Go) pean 
(x — xo)” 


has the same sign as f(x) if 0 < |x — xo| < 8. If n is odd the denominator of (2.5.11) 
changes sign in every neighborhood of xo, and therefore so must the numerator (since the 
ratio has constant sign for 0 < |x — хо| < 6). Consequently, f(xo) cannot be a local 
extreme value of f. This proves (a). If n is even, the denominator of (2.5.11) is positive 
for x Æ xo, so f(x) — f(xo) must have the same sign as f? (xo) for 0 < |x — xo| < 8. 
This proves (b). a 


For п = 2,(b) is called the second derivative test for local extreme points. 


Example 2.5.4 If f(x) = ех? then w= 3x2e*, and 0 is the only critical point 
of f. Since 
f" (x) = (6x + 9x*)e* 
and 
f" (x) = (6 + 54x? + 27х6)ех, 
f" (0) = O and f” (0) Z 0. Therefore, Theorem 2.5.3 implies that 0 is not a local extreme 


point of f. Since f is differentiable everywhere, it has no local maxima or minima. 


Example 2.5.5 If f(x) = sinx?, then f'(x) = 2x cos x, so the critical points of f 


are 0 and +4 (k + 1/2), k = 0,1,2,.... Since 


f" (x) = 2cos x? — 4x? sinx?, 
f"(0)-22 and f" (+ (К + 1/37)) = (Л) (4k + 2). 


Therefore, Theorem 2.5.3 implies that f attains local minima at 0 and + y (k + 1/2)z for 
odd integers k, and local maxima at + y (k + 1/2)z for even integers К. 


Taylor's theorem 


Theorem 2.5.1 implies that the error in approximating f(x) by T,(x) approaches zero 
faster than (x — xo)" as x approaches xo; however, it gives no estimate of the error in 
approximating f(x) by Т, (х) for a fixed x. For instance, it provides no estimate of the 
error in the approximation 


01 (01? 


0.1 ~ _ etre 
e?! s 01) = 1+ Ap E TA 


— 1.105 (2.5.12) 


obtained by setting n = 2 and x = 0.1 in (2.5.8). The following theorem provides a way 
of estimating errors of this kind under the additional assumption that f+ exists in a 
neighborhood of хо. 
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Theorem 2.5.4 (Taylor's Theorem) Suppose that f "^ exists on an open in- 
terval I about xo, and let x be in I. Then the remainder 


Rn(x) = f(x) – Tr) 


can be written as 
fe (e) 
(n 4- 1)! 


where c depends upon x and is between x and xo. 


Ёһ(х) = (x — xo)"*!, 


This theorem follows from an extension of the mean value theorem that we will prove 
below. For now, let us assume that Theorem 2.5.4 is correct, and apply it. 


Example 2.5.6 If f(x) = e*, then f"(x) = ех, and Theorem 2.5.4 with n = 2 


implies that 


2 etx? 


ПЕЛЕ Е 
2! 3! 


where c is between 0 and x. Hence, from (2.5.12), 


c(0.1)? 
e"! 211054 f x E 


where 0 < c < 0.1. Since 0 < е < e®!, we know from this that 


0.1(9,1)3 
1405 <e™! «1405 4 (00 


The second inequality implies that 


13 
e h- 22 | < 1.105, 


50 
e9 < 1.1052. 


Therefore, 
1.105 < е! < 1.1052, 


and the error in (2.5.12) is less than 0.0002. 


Example 2.5.7 In numerical analysis, forward differences are used to approximate 
derivatives. If > 0, the first and second forward differences with spacing h are defined 
by 
Af(x) = f(x +) - f(x) 
and а 
A^ f(x) = A[Af(x)] = Af(x + h) - Af(x) 
= f(x42h)—2f(x +h) + f(x). 


Higher forward differences are defined inductively (Exercise 2.5.18). 


(2.5.13) 
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We will find upper bounds for the magnitudes of the errors in the approximations 


f'Gxo) & = (2.5.14) 


and 


A? SED 


f" (xo) ж (2.5.15) 


If f" exists on an open interval containing xo and xo + h, we can use Theorem 2.5.4 to 
estimate the error in (2.5.14) by writing 


„ 2 
f (xo +h) = f (xo) + f'(xo)h + ———— f mE (2.5.16) 


where хо < c < xo + h. We can rewrite (2.5.16) as 


f (Xo +h) — f(xo) 
h 


'(c)h 
= f'(xo) = ro ; 


which is equivalent to 
f" (c)h 


— f'(xo) = 5 


Af (xo) 
һ 


Therefore, 


алло) роо) = Mah 


where M» is an upper bound for e on (xo, Xo + "e 


If f’” exists on an open interval containing xo and xo + 2h, we can use Theorem 2.5.4 
to estimate the error in (2.5.15) by writing 


2 3 
бо +h) = Flo) + Afo) +L fos) +L fe) 
and 
f 2" 4h? n 
fco +28) = /(хо) + 2А/'бх) +A f") + e) 


where хо < со < xo + hand хо < с < хо + 2h. These two equations imply that 


Fs + 28) - 2/6 +h) + fe) = I f) [S reo - Sr" | 


which can be rewritten as 


A? 4 1 
2208 У" (хө) = |57") Д] h 


because of (2.5.13). Therefore, 


je f(xo) | a 


"n 


where Мз is an upper bound for | f""| on (xo, xo + 2). 
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The Extended Mean Value Theorem 


We now consider the extended mean value theorem, which implies Theorem 2.5.4 (Exer- 
cise 2.5.24). In the following theorem, a and b are the endpoints of an interval, but we do 
not assume that a « b. 


Theorem 2.5.5 (Extended Mean Value Theorem) Suppose that f is con- 
tinuous on a finite closed interval I with endpoints a and b (that is, either I = (a,b) or 
I = (b,a)), f+ exists on the open interval 1°, and, if n > 0, that f, ..., f™ exist 
and are continuous at a. Then 


n p(r) (n+1) 
HL > f EO (b—ay = i Оф —а)"*! (2.5.17) 
r=0 ` 


(п + 1)! 
for some c in 19. 


Proof The proof is by induction. The mean value theorem (Theorem 2.3.11) implies 
the conclusion for n = 0. Now suppose that n > 1, and assume that the assertion of the 
theorem is true with п replaced by n — 1. The left side of (2.5.17) can be written as 
fE LOPS (р — а)"+! 

f(b —a) = K—— 2.5.18 

f(b) - pie ) TEN (2.5.18) 
for some number К. We must prove that К = f+ (c) for some c in I9. To this end, 
consider the auxiliary function 


(x _ а)"+! 
(n + 1)! 


л (r) 
кх) =f) - Ve - 


r=0 


а) – К 


, 


Which satisfies 


h(a) 20, h(b) — 0, 


(the latter because of (2.5.18)) and is continuous on the closed interval / and differentiable 
on 7°, with 


(r+1) _ „үп 
h'(x) = /'(х)— у= ш. E PN Е E (2.5.19) 


Therefore, Rolle's theorem (Theorem 2.3.8) implies that h’(b;) = 0 for some bı in Z°; 
thus, from (2.5.19), 


(r+1) __ „үп 
Fej- уте A eV eg 


n! 


If we temporarily write f” = g, this becomes 


n—l (т) bi —ayt 
g(bi) — у, E70 -ay — kem =0. (2.5.20) 


r=0 
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Since bı є I?, the hypotheses on f imply that g is continuous on the closed interval J 
with endpoints а and bı, g exists on J°, and, if n > 1, не 5-1) exist and are 
continuous at a (also at Б, but this is not important). The induction hypothesis, applied to 
g on the interval J, implies that 


(b — a)” 
r n 


n—l (+) (п) 
80) - у” ај e 
r=0 Ё ` 


for some c in 79. Comparing this with (2.5.20) and recalling that g = f’ yields 
K = g” (0) = f" (o). 
Since c is in /?, this completes the induction. ш 


2.5 Exercises 


_ fe? x £0, 
Ө) = lo, x=0. 
Show that f has derivatives of all orders on (—oo, oo) and every Taylor polynomial 
of f about 0 is identically zero. HINT: See Exercise 2.4.40. 
2. Suppose that f+ (хо) exists, and let Т, be the nth Taylor polynomial of f about 
хо. Show that the function 


f(x) – Tn) 


E,(x) = (x = Xo)" , 
0, х = Х0, 


хє Df — {xo}, 


is differentiable at xo, and find E, (xo). 
3. (a) Prove: If f is continuous at хо and there are constants ao and a, such that 


РО) – ao — а(х — xo) 
lim. = = 
x—x0 X — Хо 


0, 


then ао = f(xo), f’ is differentiable at xo, and f'(xo) = a1. 
(b) Give a counterexample to the following statement: If f апа f’ are continuous 
at xo and there are constants ao, a4, and a» such that 


B f(x) — ag — а(х — xo) — а(х — хо)? _ 
im UU - 
x—xo (х — хо)? 


0, 
then f" (xg) exists. 
4. (a) Prove: if f” (xo) exists, then 


f (хо A + (хо — h) = ухо). 


lim 
h—>0 
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(b) Prove or give a counterexample: If the limit in (a) exists, then so does 
f" (xo), and they are equal. 


A function f has a simple zero (or a zero of multiplicity 1) at xo if f is differentiable 
in a neighborhood of хо and f'(xo) = 0, while f'(xo) Æ 0. 


(a) Prove that f has a simple zero at xo if and only if 


f(x) = gG)(x — хо), 


where g is continuous at xo and differentiable on a deleted neighborhood of 
Xo, and g(xo) Æ 0. 
(b) Give an example showing that g in(a) need not be differentiable at хо. 


A function f has a double zero (or a zero of multiplicity 2) at xo if f is twice dif- 
ferentiable on a neighborhood of xo and f(xo) = f'(xo) = 0, while f"(xg) Æ 0. 


(a) Prove that f has a double zero at xo if and only if 


f(x) = в(х)(х — хо)?, 


where g is continuous at хо and twice differentiable on a deleted neighborhood 
of xo, &(хо) + 0, and 


lim (x — хо) (х) = 0. 
X— X0 


(b) Give an example showing that g in(a) need not be differentiable at xo. 


Let n be a positive integer. A function f has a zero of multiplicity n at xo if f 
is n times differentiable on a neighborhood of хо, f(xo) = f'(xo) = ++: = 
fOD (xo) = 0 and f™ (хо) Æ 0. Prove that f has a zero of multiplicity п at 
хо if and only if 


F(x) = g(x)(x — xo)", 
where g is continuous at xo and n times differentiable on a deleted neighborhood of 
Xo, £(xo) # 0, and 


lim (х – хо)/ 200 (x) 20, 1j €n- 1. 
x—>xo 


HINT: Use Exercise 2.5.6 and induction. 
(a) Let 
Q(x) = ag + a4 (x — хо) +--+ + On (x — xo)" 
be a polynomial of degree < n such that 
Q(x) 


li =0 
Paren (x — xo)” 


Show that шо = a] =--- =a, = 0. 


10. 


11. 
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(b) Suppose that f is n times differentiable at xo and p is a polynomial 
р(х) = ao + a1(x — xo) +++ ап(х — xo)" 


of degree < n such that 


x—xo (x — Xo)" 


Show that 


that is, p = Ty, the nth Taylor polynomial of f about хо. 
Show that if f (хо) and g™ (хо) exist and 


km 099—809 _ 
и ——————— = 


xoxo (х — хо)" 


0, 


then f™ (xo) = g (xo), O<r<n. 


(a) Let Fa, Gn, and Н, be the nth Taylor polynomials about xo of f, g, and 
their product h = fg. Show that Н, can be obtained by multiplying Fn 
by Gn and retaining only the powers of x — xo through the nth. HINT: Use 
Exercise 2.5.8(b). 

(b) Use the method suggested by (a) to compute A"? (xo), г = 1,2,3, 4. 

(i) A(x) =e*sinx, xo =0 

(ii) A(x) = (cosax/2)(logx), xo = 1 
(11) A(x) = х2 cosx, xo = 7/2 
(iv) h(x) =(1+x)le*, x9 =0 

(a) It can be shown that if g is п times differentiable at x and f is n times dif- 
ferentiable at g(x), then the composite function h(x) = f(g(x)) is n times 
differentiable at x and 


à a» rio (s Gy" (e" GN? бү” 
п) = ff ee Y ( T) ( 3; ) --( = 


r=1 
where Y. is over all n-tuples (r1, r2, . .., Fn) of nonnegative integers such that 
ri Hro + +m =r 
and 


rı T 2ro +e + пр =n. 


(This is Faa di Bruno’s formula). However, this formula is quite complicated. 
Justify the following alternative method for computing the derivatives of a 
composite function at a point xo: 
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12. 


13. 


14. 


(b) 
(a) 


(b) 


(c) 


Let Ё, be the nth Taylor polynomial of f about yo = g(xo), and let G, and 
Н, be the nth Taylor polynomials of g and h about хо. Show that H, can 
be obtained by substituting С, into Ё, and retaining only powers of x — xo 
through the mth. HINT: See Exercise 2.5.8(b). 

Compute the first four derivatives of h(x) = cos(sin x) at xo = 0, using the 
method suggested by (a). 


If g(xo) Æ 0 and g? (хо) exists, then the reciprocal h = 1/g is also n times 
differentiable at xo, by Exercise 2.5.11(a), with f(x) = 1/x. Let Gn and Н, 
be the nth Taylor polynomials of g and h about xo. Use Exercise 2.5.11 (a) to 
prove that if g(xo) = 1, then Н, can be obtained by expanding the polynomial 


XO- Groo 
r=1 


in powers of x — Xo and retaining only powers through the nth. 

Use the method of (a) to compute the first four derivatives of the following 
functions at xo. 

(i) A(x) =cscx, xo = 2/2 

(ii) А(х) =(14+x4+x7)1, x9 =0 

(ii) h(x) = secx, xo = 7/4 

(iv) (х) = 1 + 108(1 + x) !, xo =0 
Use Exercise 2.5.10 to justify the following alternative procedure for obtaining 
И, again assuming that g(xo) = 1: If 


Gn(x) = 1 + a1 (x — хо) + +++ + an (x — xo)" 
(where, of course, a, = g ? (xo)/r!) and 
Hy (x) = bo + b(x — xo) + +++ + bn (x — хо)", 
then 
k 


bo = 1, by = – Yo arbk-r, 1<k <n. 


r=1 


Determine whether хо = 0 is a local maximum, local minimum, or neither. 


iuge (b) f(x) = ide? 

1 2 1 3 
(c) 70) = 5 (4) fe) - 1555 
(e) f(x) = x? sin? x + x? cos x (£) f(x) = e” sinx 
(g) f(x) = e* sinx? (h) f(x) = e* cosx 


Give an example of a function that has zero derivatives of all orders at a local mini- 
mum point. 


15. 


16. 


17. 


18. 


In Exercises 2.5.19—2.5.22, A is the forward difference operator with spacing h > 0. 
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Find the critical points of 
x? bx? 
№) = — + — +cx+d 
3 2 
and identify them as local maxima, local minima, or neither. 
Find an upper bound for the magnitude of the error in the approximation. 
л 


(a) sinx zx, Ix| < 55 


x 1 
(b) Vitx e145, Ini s 


(c) cosx ғ SER 22252 
(d) logx = (х — pott. 


Prove: If 


n r 


Ty (x) = у, = 


r=0 


then 


хт! -1 
Ta (x) < Ty4i(x) < e* < | — em Тл (x) 


if0 < x < [(n + Iyer, 


The forward difference operators with spacing h > 0 are defined by 


A? f(x) = f(x), Af(x)- f(x +h) - f(x), 


ArH f(x) = A[A"fG)]. nzl. 
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(a) Prove by induction on n: If k > 2, c1, ..., cy are constants, and n > 1, then 


AP ley fix) ek fe О) = eA" fix) +--+ ex" fix). 


(b) Prove by induction: If n 7 1, then 


A" f() = ус” (5 f(x + mh). 
m=0 


HINT: See Exercise 1.2.19. 
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19. 


20. 


21. 


22. 


23. 


24. 
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Let m and n be nonnegative integers, and let x9 be any real number. Prove by 
induction on n that 


0 if O<m<n, 


ney __ m _ 
ANG — xo) nih” if т=п. 


Does this suggest an analogy between “differencing” and differentiation? 
Find an upper bound for the magnitude of the error in the approximation 
A? f (xo = h) 

f" (xo) ж — r 


(a) assuming that f" is bounded on (xo — h, xo + h); 
(b) assuming that f% is bounded on (xo — h, xo + h). 


Let f” be bounded on an open interval containing xo and хо + 2h. Find a constant 
k such that the magnitude of the error in the approximation 


2 
гоо 5/69) p 068) 


is not greater than Mh?, where М = sup {| f" (с)| | [хо < с < хо}. 


Prove: If f+ is bounded on an open interval containing xo and хо + nh, then 


A” 
m — f? (хо) € AnMn+ıh, 


where A, is a constant independent of f and 


Masi = sup |F]. 


xo«c «xo nh 


HINT: See Exercises 2.5.18 and 2.5.19. 


Suppose that f+ exists on (a, b), xo, ..., Xn are in (a, b), and p is the polyno- 
mial of degree < n such that р(х;) = f(xj), 0 € i < n. Prove: If x € (a,b), 
then ET 
n 
(c) 
уо) = ро) + LO s хок = x) = л), 


(п + 1)! 
where c, which depends on x, is in (a, b). HINT: Let x be fixed, distinct from xo, 
X1, -.., Xn, and consider the function 


gy) = f) - р(у) – (y = xo)(y — xi): (У — Xn), 


K 
“+D! 


where K is chosen so that g(x) = 0. Use Rolle’s theorem to show that K = 
f@*) (с) for some c in (a, b). 


Deduce Theorem 2.5.4 from Theorem 2.5.5. 


CHAPTER 3 


Integral Calculus of 
Functions of One Variable 


IN THIS CHAPTER we discuss the Riemann on a finite interval [a, b], and improper inte- 
grals in which either the function or the interval of integration is unbounded. 


SECTION 3.1 begins with the definition of the Riemann integral and presents the geo- 
metrical interpretation of the Riemann integral as the area under a curve. We show that 
an unbounded function cannot be Riemann integrable. Then we define upper and lower 
sums and upper and lower integrals of a bounded function. The section concludes with the 
definition of the Riemann-Stieltjes integral. 


SECTION 3.2 presents necessary and sufficient conditions for the existence of the Riemann 
integral in terms of upper and lower sums and upper and lower integrals. We show that 
continuous functions and bounded monotonic functions are Riemann integrable. 


SECTION 3.3 begins with proofs that the sum and product of Riemann integrable functions 
are integrable, and that | f | is Riemann integrable if f is Riemann integrable. Other topics 
covered include the first mean value theorem for integrals, antiderivatives, the fundamental 
theorem of calculus, change of variables, integration by parts, and the second mean value 
theorem for integrals. 

SECTION 3.4 presents a comprehensive discussion of improper integrals. Concepts de- 
fined and considered include absolute and conditional convergence of an improper integral, 
Dirichlet’s test, and change of variable in an improper integral. 

SECTION 3.5 defines the notion of a set with Lebesgue measure zero, and presents a 
necessary and sufficient condition for a bounded function f to be Riemann integrable on 
an interval [a, b]; namely, that the discontinuities of f form a set with Lebesgue masure 
Zero. 


3.1 DEFINITION OF THE INTEGRAL 


The integral that you studied in calculus is the Riemann integral, named after the German 
mathematician Bernhard Riemann, who provided a rigorous formulation of the integral to 
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replace the intuitive notion due to Newton and Leibniz. Since Riemann’s time, other kinds 
of integrals have been defined and studied; however, they are all generalizations of the 
Riemann integral, and it is hardly possible to understand them or appreciate the reasons for 
developing them without a thorough understanding of the Riemann integral. In this section 
we deal with functions defined on a finite interval [a,b]. A partition of |a, b] is a set of 
subintervals 


[хо, х1], [x1, х2],..., [Xn=1; Xn], (3.1.1) 
where 


а = ху < X1: € Xn =b. (3.1.2) 


Thus, any set of n + 1 points satisfying (3.1.2) defines a partition P of [a, b], which we 
denote by 
P = (xo, X1... Xn]. 


The points xo, x1, ..., x4 are the partition points of P. The largest of the lengths of the 
subintervals (3.1.1) is the norm of Р, written as || P ||; thus, 


| P || = max (x; — xi-1). 
1xixn 
If P and P' are partitions of [a, b], then P’ is a refinement of P if every partition point 


of P is also a partition point of P"; that is, if P’ is obtained by inserting additional points 
between those of P. If f is defined on [a, b], then a sum 


o = x | /(су)(ху cassa) 


j=1 
where 
Xj 2S6 Sxj, lszjzn, 
is a Riemann sum of f over the partition Р = (xo, Х1,..., Xn}. (Occasionally we will say 


more simply that ø is a Riemann sum of f over [a, b].) Since c; can be chosen arbitrarily 
in [x j, x j 1], there are infinitely many Riemann sums for a given function f over a given 
partition Р. 


Definition 3.1.1 Let f be defined on [a, b]. We say that f is Riemann integrable on 
[а, b] if there is a number L with the following property: For every є > 0, there isa ô > 0 
such that 

lo- L| <e 


if о is any Riemann sum of f over a partition P of [a, b] such that || P || < 6. In this case, 
we say that L is the Riemann integral of f over [a, b], and write 


[ f(x)dx = L. 
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We leave it to you (Exercise 3.1.1) to show that /? f (x) dx is unique, if it exists; that is, 
there cannot be more than one number L that satisfies Definition 3.1.1. 

For brevity we will say “integrable” and “integral” when we mean “Riemann integrable” 
and “Riemann integral.” Saying that f is f (x) dx exists is equivalent to saying that f is 


integrable on [a, b]. 


Example 3.1.1 If 


then 


n 


у, Л(су)(ху—ху-1) = У 05 — Х]-1). 


j=1 j=1 
Most of the terms in the sum on the right cancel in pairs; that is, 


n 
Уу p — Xj-1) = (x1 — xo) + (x2 — X1) +++ Xn — Xn-1) 
j=l 
= —X + (x1 — x1) + (X2 — x2) +++ Gaia — Xn-1) + Xn 
= Xn — X0 


—b-a. 


Thus, every Riemann sum of f over any partition of [a, b] equals b — a, so 


b 
f dx —b-—a. 


Example 3.1.2 Riemann sums for the function 
х) = х, a<x<b, 
are of the form 


n 
о = у ejr Xj): (3.1.3) 
j=l 
Since xj—1 € cj < xj and (x; + xj-1)/2 is the midpoint of [x ;-1, xj], we can write 


c= 2 + dj, (3.1.4) 
where IPI 
Xj — Ху 
quje Ses е 3.1.5 
|4}| < 5 = — ( ) 


Substituting (3.1.4) into (3.1.3) yields 


n 


n 
X; X; 
с= У 2—00; = хул) + У dj(xj xj) 


m А j=l (3.1.6) 
= MES — x5 4) + 3 dj — xj-1). 
j=l 


jet 
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Because of cancellations like those in Example 3.1.1, 
n 
205 хўр) = b5 -a’, 
j=l 


so (3.1.6) can be rewritten as 


b? — a? 
2 


n 
с = + Уау x2) 
j=1 
Hence, 


n P n 
s Mjl;-xj-0s |1 у («у—ху-14) (вее G.1.5)) 
j=l 


j=l 


b? — а? 
2 


= Ig — a). 


Therefore, every Riemann sum of f over a partition P of [a, b] satisfies 


2€ 
b— 


b2 — а? 


«e if [Р < = 


Hence, 


The Integral as the Area Under a Curve 


An important application of the integral, indeed, the one invariably used to motivate its 
definition, is the computation of the area bounded by a curve y = f(x), the x-axis, and 
the lines x = a and x = b (“the area under the curve"), as in Figure 3.1.1. 


M 


Figure 3.1.1 
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For simplicity, suppose that f(x) > 0. Then f(c;)(x; — xj—1) is the area of a rectangle 
with base x; — ху—1 and height f(c;), so the Riemann sum 


Уу fic); –х;-1) 
j=l 


can be interpreted as the sum of the areas of rectangles related to the curve y = f(x), as 
shown in Figure 3.1.2. 


y=f) 


Figure 3.1.2 


An apparently plausible argument, that the Riemann sums approximate the area under 
the curve more and more closely as the number of rectangles increases and the largest of 
their widths is made smaller, seems to support the assertion that f i f(x) dx equals the 
area under the curve. This argument is useful as a motivation for Definition 3.1.1, which 
without it would seem mysterious. Nevertheless, the logic is incorrect, since it is based 
on the assumption that the area under the curve has been previously defined in some other 
way. Although this is true for certain curves such as, for example, those consisting of line 
segments or circular arcs, itis not true in general. In fact, the area under a more complicated 
curve is defined to be equal to the integral, if the integral exists. That this new definition is 
consistent with the old one, where the latter applies, is evidence that the integral provides 
a useful generalization of the definition of area. 


Example 3.1.3 Let f(x) = x, 1 < x < 2 (Figure 3.1.3, page 118). The region under 


the curve consists of a square of unit area, surmounted by a triangle of area 1/2; thus, the 
area of the region is 3/2. From Example 3.1.2, 


ӯ 1 3 
/ хах = -(2 - руе =, 
1 2 2 


so the integral equals the area under the curve. 
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Figure 3.1.3 


Figure 3.1.4 


Example 3.1.4 If 
fix 1sxz2 


(Figure 3.1.4), then 
f towa 103-12) = 2 
X X=- = = — 
1 3 3 


(Exercise 3.1.4), so we say that the area under the curve is 7/3. However, this is the defini- 
tion of the area rather than a confirmation of a previously known fact, as in Example 3.1.3. 
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Theorem 3.1.2 If f is unbounded on |a, b], then f is not integrable on [а, b]. 


Proof We will show that if f is unbounded on [a, b], P is any partition of [a, b], and 
M > 0, then there are Riemann sums o and с’ of f over P such that 


lo — о'| > M. (3.1.7) 


We leave it to you (Exercise 3.1.2) to complete the proof by showing from this that f 
cannot satisfy Definition 3.1.1. 


Let a 
o=} fej- xj) 
j=1 


be a Riemann sum of f over a partition P of [a,b]. There must be an integer i in 
{1,2,...,m} such that 


M 
ПОЕ == (3.1.8) 


Xi-1 


for some c in [xj .1x;], because if there were not so, we would have 
M ; 
РО) – f(ej)) < ————. xjisxzxj 15Ј хи. 
Xj —Xj-1 


Then 


IFO = [Fle + FOC) – FeAl < IFA + |/@)— Л) 


M 
efe) q——— ауре а Тере, 
Xj —Xj ` 


1—1 
which implies that 


M 
ІРО) S max |fe + ——_, a<x<b, 
1xjzn Xj —Xj 


contradicting the assumption that f is unbounded on [a, b]. 


Now suppose that c satisfies (3.1.8), and consider the Riemann sum 


с! = Е (с); — Xj-1) 


j=l 


over the same partition P, where 
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Since 
le —6'| = |f() — fed |G — xi-1). 
(3.1.8) implies (3.1.7). ш 


Upper and Lower Integrals 


Because of Theorem 3.1.2, we consider only bounded functions throughout the rest of this 
section. 


To prove directly from Definition 3.1.1 that / P f (x) dx exists, it is necessary to discover 
its value L in one way or another and to show that L has the properties required by the 
definition. For a specific function it may happen that this can be done by straightforward 
calculation, as in Examples 3.1.1 and 3.1.2. However, this is not so if the objective is to find 
general conditions which imply that f. i f(x) dx exists. The following approach avoids the 
difficulty of having to discover L in advance, without knowing whether it exists in the first 
place, and requires only that we compare two numbers that must exist if f is bounded on 


[a, b]. We will see that /? f (x) dx exists if and only if these two numbers are equal. 


Definition 3.1.3 If f is bounded on [а,Ь] and P = (xo, x1, ..., Xn} is a partition of 
[а, b], let 


M; = sup f (x) 
Xj-1SXS%Xj 
and 
m; = inf — f(x). 


xj-1€xXxj 
The upper sum of f over P is 
n 
S(P) = È` My (xj — ху), 
Ј=1 


and the upper integral оў f over, |a, b], denoted by 


[fo dx, 


is the infimum of all upper sums. The lower sum of f over P is 


s(P) = i mj (x; = ху-1), 


Ј=1 


and the lower integral оў f over [а, b], denoted by 


| бй, 


is the supremum of all lower sums. ш 
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If m < f(x) x M for all x in [a, b], then 
m(b —a) x s(P) x S(P) x M(b —a) 
for every partition P; thus, the set of upper sums of f over all partitions P of [a, b] is 
bounded, as is the set of lower sums. Therefore, Theorems 1.1.3 and 1.1.8 imply that 


JT is f(x) dx and f » f (x) dx exist, are unique, and satisfy the inequalities 


eb 
mba) = | f(x)dx < M(b —a) 
and 


b 
m(b — a) = | f(x) ах < M(b — a). 


Theorem 3.1.4 Let f be bounded on [a,b], and let P be a partition of [a, b]. Then 


(a) The upper sum S(P) of f over P is the supremum of the set of all Riemann sums of 
f over P. 


(b) The lower sum s(P) of f over P is the infimum of the set of all Riemann sums of f 
over P. 


Proof (a) If P = (xo, х1,..., Xn}, then 


S(P) = Mj; — х-л), 


j=l 
where 
Mj;= sp f(x). 


Xj-1SXSXj 


An arbitrary Riemann sum of f over P is of the form 


o =} (с); - xj-1), 


Ј=1 
where xj—1 € cj < xj. Since f (су) < Mj, it follows that о < S(P). 
Now let € > 0 and choose c; in [xj 1, xj] so that 


€ 


Хеу) > М; – "TERCER Ixjznmn. 
The Riemann sum produced in this way is 
n n 
T=}, fe) -xj-0» У; [m = xy (xj —xj-1) = S(P) - €. 
j=l j=l n(x j = Xj-1) 


Now Theorem 1.1.3 implies that S(P) is the supremum of the set of Riemann sums of f 
over P. 


(b) Exercise 3.1.7. и 
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Example 3.1.5 Let 


О if x is irrational, 
f(xy) = pup Mi 
] ifxisrational, 
and P = (xo, x1, ..., Xn} be a partition of [a, b]. Since every interval contains both ratio- 


nal and irrational numbers (Theorems 1.1.6 and 1.1.7), 
ту =O and M;=1, 1<j <n. 
Hence, 
n 
S(P) 2M 1. - хул) =b-a 
Ј=1 
апа 
п 
(Р) = У`0: (xj – xj-1) = 0. 
Ј=1 


Since all upper sums equal b — а and all lower sums equal 0, Definition 3.1.3 implies that 
pb b 
| f(x)dx 2b-—a and 1 f(x) dx = 0. 
a a 


Example 3.1.6 Let f be defined on [1, 2] by f(x) = Oif x is irrational and f(p/q) = 
1/q if p and q are positive integers with no common factors (Exercise 2.2.7). If P = 
{х0, Х1,..., Хп} is any partition of [1,2], then m; = 0,1 < j < n, sos(P) = 0; hence, 


2 
f f(x)dx =0. 
a 


We now show that 


E 
/ /ох)ах =0 (3.1.9) 
1 
also. Since S(P) > 0 for every P, Definition 3.1.3 implies that 
EY 
f f(x) dx > 0, 
1 
so we need only show that 
2 
| f(x)dx <0, 
1 


which will follow if we show that no positive number is less than every upper sum. To this 
end, we observe that if 0 < є < 2, then f(x) > є/2 for only finitely many values of x in 
[1,2]. 

Let k be the number of such points and let Po be a partition of [1, 2] such that 


€ 
P = 11 
I Poll < 5 (3.1.10) 
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Consider the upper sum 


n 
S(Po) = 3 Mj(x; - xj). 
j=1 
There are at most k values of j in this sum for which M; > €/2, and M; < 1 even for 
these. The contribution of these terms to the sum is less than k(e/2k) = є/2, because of 
(3.1.10). Since M; < є/2 for all other values of j, the sum of the other terms is less than 


n 
€ € € € 
= Xj —Xj-1) = =n — Xo) = —(2—1) = 5. 
5 2-6 j-1) = б» х) = 50-1) = 5 
Therefore, S(Po) < є and, since є can be chosen as small as we wish, no positive number 


is less than all upper sums. This proves (3.1.9). ш 


The motivation for Definition 3.1.3 can be seen by again considering the idea of area 
under a curve. Figure 3.1.5 shows the graph of a positive function y = f(x),a <x < b, 
with [a, b] partitioned into four subintervals. 


y 


Figure 3.1.5 


The upper and lower sums of f over this partition can be interpreted as the sums of the areas 
of the rectangles surmounted by the solid and dashed lines, respectively. This indicates that 
a sensible definition of area A under the curve must admit the inequalities 


s(P) <А < 8(Р) 


for every partition Р of [a,b]. Thus, А must be an upper bound for all lower sums and a 
lower bound for all upper sums of f over partitions of [a, b]. If 


“Ab b 
| тода = | лах, (3.1.41) 
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there is only one number, the common value of the upper and lower integrals, with this 
property, and we define A to be that number; if (3.1.11) does not hold, then A is not defined. 
We will see below that this definition of area is consistent with the definition stated earlier 


in terms of Riemann sums. 

Example 3.1.7 Returning to Example 3.1.3, consider the function 
х) = х, 1<x <2. 

If P = (xo. х1,..., Xn} is a partition of [1, 2], then, since f is increasing, 


M; = f(xj) =x; and mj; = f(xj-1) = Xj-1. 


Hence, 
n 
S(P)= у ax ex) 
Ј=1 
апа 
п 
s(P) = b» xj-1(xj = Xj—1). 
j=l 
By writing 
_ Xj +tXj-1 | Xj- Xj- 
Xj m 2 sr 2 , 
we see from (3.1.12) that 
ES 2. 2 ES 2 
50Р) = > У -xj.) + z 2,63 у) 
j=l j=l 


1 pus 
230-1) 5 Gy xj. 
j=l 


Since К Р 
о<ўу (ху—ху-)° x IPIS (0 – xj) = [Р|(@—1), 
j=l j=l 
(3.1.14) implies that 
3 3 ||P Il 
= < S(P) < – + —. 
5 Usta 


Since ||P || can be made as small as we please, Definition 3.1.3 implies that 


— А 
f(x)dx = =. 
а 
A similar argument starting from (3.1.13) shows that 
3 ql. 3 


г! ру < 2 
2 3 5 *Р) < 5; 


(3.1.12) 


(3.1.13) 


(3.1.14) 
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so 
3 


[ юв E 


Since the upper and lower integrals both equal 3/2, the area under the curve is 3/2 accord- 
ing to our new definition. This is consistent with the result in Example 3.1.3. 


The Riemann-Stieltjes Integral 


The Riemann-Stieltjes integral is an important generalization of the Riemann integral. We 
define it here, but confine our study of it to the exercises in this and other sections of this 
chapter. 


Definition 3.1.5 Let f and g be defined on [a, b]. We say that f is Riemann-Stieltjes 
integrable with respect to g on [a, b] if there is a number L with the following property: 
For every є > 0, there is a ё > 0 such that 


n 
Y fei) [80) - 26-0] - L| < e. (3.1.15) 
j=1 
provided only that P = (xo, х1,..., Xn} is a partition of [a, b] such that || P || < 6 and 
xjizXcjzxj j-—12,...n. 


In this case, we say that L is the Riemann-Stieltjes integral of f with respect to g over 
[a, b], and write 


b 
| f(x) dg(x) = L. 
The sum : 
3 renle- #0-1)] 
Ј=1 


in (3.1.15) is a Riemann-Stieltjes sum of f with respect to g over the partition Р. 


3.1 Exercises 


1. Show that there cannot be more than one number L that satisfies Definition 3.1.1. 


2. (a) Prove: If H f (x) dx exists, then for every є > 0, there isa ô > 0 such that 
|01 — 02| < € if o4 and о» are Riemann sums of f over partitions P, and P5 
of [a, b] with norms less than 6. 
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(b) Suppose that there is an M > 0 such that, for every 5 > 0, there are Riemann 
sums о and o» over a partition P of [a, b] with ||P || < 6 such that |o1 — 02| > 
М. Use (a) to prove that f is not integrable over [a, b]. 


3. Suppose that f B f (x) dx exists and there is a number A such that, for every є > 0 
and ó > 0, there is a partition P of [a, b] with || P|| < 6 and a Riemann sum c of f 


over P that satisfies the inequality |o — A| < €. Show that P f(x)dx = A. 


4. Prove directly from Definition 3.1.1 that 


b 3 3 
b3— 

| а= ay 
P 3 


Do not assume in advance that the integral exists. The proof of this is part of the 
problem. HINT: Let P = (xo, x2, ..., Xn} be an arbitrary partition of |a, b]. Use 
the mean value theorem to show that 


b? — a3 ш 
3 = di xj) 
j=1 


for some points di, ..., dn, where ху] < dj < xj. Then relate this sum to 
arbitrary Riemann sums for f(x) = x? over P. 


5. Generalize the proof of Exercise 3.1.4 to show directly from Definition 3.1.1 that 
b pmti. qmtl 
f x” dx = i 
a 


if m is an integer > 0. 


6. Prove directly from Definition 3.1.1 that f (x) is integrable on [a, b] if and only if 
f (—x) is integrable on [—b, —a], and, in this case, 


b —a 
| feos = А f(—x) dx. 


7. Let f be bounded on [a, b] and let P be a partition of [a, b]. Prove: The lower sum 
5(Р) of f over P is the infimum of the set of all Riemann sums of f over P. 
8. Let f be defined on [a, b] and let P = (xo, x1, ..., Xn} be a partition of [a, b]. 


(a) Prove: If f is continuous on [a, b], then s(P) and S(P) are Riemann sums of 
f over P. 

(b) Name another class of functions for which the conclusion of (a) is valid. 

(c) Give an example where 5(Р) and S(P) are not Riemann sums of f over Р. 


10. 


11. 


12. 


13. 


14. 


15. 


16. 
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Find darts) dx and ғо) dx if 


x if x is rational, 1 if x is rational, 
VERNA (b) f(x) = PP RM 
x if x is irrational. x if x is irrational. 


(a) f(x) 21. 


Given that f. E e* dx exists, evaluate it by using the formula 


1— phil 


I-lrcrr)-elrnr't- = (т z 1) 


to calculate certain Riemann sums. HINT: See Exercise 3.1.3. 


Given that i sin x dx exists, evaluate it by using the identity 
cos(j — 1)0 — cos(j + 1)0 = 2sin6 sin /0 


to calculate certain Riemann sums. HINT: See Exercise 3.1.3. 


Given that F cos x dx exists, evaluate it by using the identity 
sin(j + 1)0 —sin(j — 1)0 = 2 sin Ө cos j0 


to calculate certain Riemann sums. HINT: See Exercise 3.1.3. 
Show that if g(x) = x + c (c=constant), then f f(x)dg(x) exists if and only if 
/? f (x) dx exists, in which case 


| djs | ” f) dx. 


Suppose that —oo <a < d < c < oo and 


se) = |6, a«x«d, 


бз, d<x<b (g1, 2 = constants), 


and let g(a), g(b), and g(d) be arbitrary. Suppose that f is defined on [а, 2], 
continuous from the right at a and from the left at b, and continuous at d. Show that 
f f (x) dg(x) exists, and find its value. 


Suppose that Coo < a = ао < ај < +++ < ap = b < œ, let g(x) = gm 
(constant) on (@m—1,dm), 1 € m < p, and let g(ao), g(a1), ..., g(a p) be arbitrary. 
Suppose that f is defined on [a, b], continuous from the right at a and from the 
left at b, and continuous at a1, 42, ..., ар-1. Evaluate ГИ f(x) dg(x). HINT: See 
Exercise 3.1.14. 


(a) Give an example where f i f (x) dg(x) exists even though f is unbounded 
on [a, b]. (Thus, the analog of Theorem 3.1.2 does not hold for the Riemann- 
Stieltjes integral.) 


(b) State and prove an analog of Theorem 3.1.2 for the case where g is increasing. 


128 Chapter 3 Integral Calculus of Functions of One Variable 


17. For the case where g is nondecreasing and f is bounded on [a, b], define upper and 
lower Riemann-Stieltjes integrals in a way analogous to Definition 3.1.3. 


3.2 EXISTENCE OF THE INTEGRAL 


The following lemma is the starting point for our study of the integrability of a bounded 
function f on a closed interval [a, b]. 


Lemma 3.2.1 Suppose that 


|f(x) <M, a<x<b, (3.2.1) 
and let Р! be a partition of |a, b] obtained by adding г points to a partition Р = {xo,X1,..-, Xn} 
of |a, b]. Then 
S(P) > S(P^) > S(P) - 2Mr||P | (3.2.2) 
and 
s(P) € s(P^) < s(P) - 2Mr||P |. (3.2.3) 


Proof We will prove (3.2.2) and leave the proof of (3.2.3) to you (Exercise 3.2.1). 
First suppose that r = 1, so P’ is obtained by adding one point c to the partition P = 
Íxo, X1,..., X45; then хур < c < x; for some i in {1,2,...,n}. If j Æ i, the prod- 
uct M;(x; — xj—1) appears in both S(P) and S(P") and cancels out of the difference 
S(P) — S(P"). Therefore, if 


Mi = sup f(x) and Mi = sup f(x), 


хі <х<с сех; 
then 

S(P) — S(P") = Mi(xi — xi-1) - Mau (c — xi-1) — Mi2(xi — с) 

= (Mi — Mii)(c — xi-1) + (Mi — Mi2)(xi — с). 


(3.2.4) 


Since (3.2.1) implies that 
0 < Mi — Mir <2M, r=1,2, 
(3.2.4) implies that 
0 < S(P) – S(P) < 2M(xi — xj-1) < 2M ||P ||. 


This proves (3.2.2) for r = 1. 


Now suppose that r > 1 and P’ is obtained by adding points сі, со, ..., Cr to P. Let 
PO = P and, for j > 1, let РО) be the partition of [a,b] obtained by adding с j to 
PU, Then the result just proved implies that 


0 < S(PU-YD)— S(P) <2MIPU-Y], 1<j <r. 
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Adding these inequalities and taking account of cancellations yields 
0s S(P)— S(P) sz2M(pP OL [POR + PPD. (32.5) 


Since PO = P, PO = Р’, and || P9|| < | PV-D| for1 < k < r — 1, (3.2.5) implies 
that 
0 < S(P) - S(P') < 2Mr|P ||, 


which is equivalent to (3.2.2). E 


Theorem 3.2.2 If f is bounded on [а, b], then 


b ET 
f f(x)dx < | f(x) dx. (3.2.6) 
a a 
Proof Suppose that Р; and Р» are partitions of [a,b] and P’ is a refinement of both. 
Letting P = P; in (3.2.3) and P = Р» in (3.2.2) shows that 
s(P1) € s(P and S(P^) < S(P5). 


Since s(P^) < S(P’), this implies that s(P1) < S(P2). Thus, every lower sum is a lower 


bound for the set of all upper sums. Since f, E f (x) dx is the infimum of this set, it follows 
that 


Б 
(Ру) < / fx) dx 


for every partition Р! of [a,b]. This means that f i f (x) dx is an upper bound for the set 
of all lower sums. Since /? f(x) dx 15 the supremum of this set, this implies (3.2.6). E 


Theorem 3.2.3 If f is integrable on [а, b], then 
b ET b 
f годах = | f(x)dx =] f(x)dx. 
Proof We prove that ШӨ ах = /? f (x) dx and leave it to you to show that Г? ғо) dx = 


/? J (x) dx (Exercise 3.2.2). 


Suppose that P is a partition of [a, b] and o is a Riemann sum of f over Р. Since 


m b b 
| fla) dx- f fax = fü fG)dx- se) + (CP) - o) 
b 
+ -J f(x) ix) | 
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the triangle inequality implies that 


m b ab 
| тоа | ғо) ах < f f(x) dx — S(P)| + |S(P) -o| 


(3.2.7) 
+ 


o- [feas 


Now suppose that € > 0. From Definition 3.1.3, there is a partition Po of [a, b] such that 
pb EU 2 
] f(x)dx € S(Po) < Í f(x)dx + з” (3.2.8) 
а а 
From Definition 3.1.1, there is a ё > 0 such that 


o- f fend: 


d (3.2.9) 
: 2. 


if | Р || < 8. Now suppose that || P || < б and P isa refinement of Ро. Since S(P) < S(Po) 
by Lemma 3.2.1, (3.2.8) implies that 
ET! pb É 
[ fed < 50) f fend e S. 
a a 3 
so 


E 
sa»- f у(х) dx << (3.2.10) 


in addition to (3.2.9). Now (3.2.7), (3.2.9), and (3.2.10) imply that 


eee ” ex) dx 
Loe], 


for every Riemann sumo of f over P. Since S(P) is the supremum of these Riemann 
sums (Theorem 3.1.4), we may choose o so that 


2 
< = Is) - e| (3.2.11) 


€ 
S(P) — =. 
eel a 


Now (3.2.11) implies that 
< є. 


| ru ” fe) dx 
jer 


Since e is an arbitrary positive number, it follows that 


foe = ” feo dz. 
не 
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ш 
Lemma 3.2.4 If f is bounded on |a, b] and € > 0, there is a5 > 0 such that 
ETÀ ETÀ 
f fede = 50Р) < | f(x)dx + є (3.2.12) 
апа 
b b 
f f(x)dx > s(P) > | f(x)dx — є 
if || P || < 8. 


Proof We show that (3.2.12) holds if || P || is sufficiently small, and leave the rest of the 
proof to you (Exercise 3.2.3). 


The first inequality in (3.2.12) follows immediately from Definition 3.1.3. To establish 
the second inequality, suppose that | /(x)| < K ifa < x < b. From Definition 3.1.3, there 
is a partition Ро = (xo, x1, ..., Xr+1} of [a, b] such that 


E: 
S(Po) «f f(x)dx + =. (3.2.13) 


If P is any partition of [a, b], let P’ be constructed from the partition points of Ро and Р. 
Then 
S(P') € S(Po), (3.2.14) 


by Lemma 3.2.1. Since P’ is obtained by adding at most r points to P, Lemma 3.2.1 
implies that 
S(P’) > S(P) —2Kr||P |. (3.2.15) 


Now (3.2.13), (3.2.14), and (3.2.15) imply that 


S(P) x S(P^) + 2Kr|P || 
< S(Po) + 2Kr ||P || 


ES 
< | f(x) dx + $ 4 2Kr|P |. 


Therefore, (3.2.12) holds if 


€ 
Р| < = —. 
IPI <6 = L— 
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Theorem 3.2.5 If f is bounded on [a, b] and 


/ TODE [ ros zd 


then f is integrable on [а, b] and 


i f(x)dx = L. 


(3.2.16) 


(3.2.17) 
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Proof Ife > 0, there isa $ > 0 such that 


b “7b 
f f(x)dx —e«s(P) x S(P) < | f(x)dx + є (3.2.18) 
а а 
if || P || < 6 (Lemma 3.2.4). If o is a Riemann sum of f over Р, then 
s(P) xo < S(P), 
so (3.2.16) and (3.2.18) imply that 
L—-e«o«L-ce 


if ||P || < 6. Now Definition 3.1.1 implies (3.2.17). a 
Theorems 3.2.3 and 3.2.5 imply the following theorem. 


Theorem 3.2.6 A bounded function f is integrable on [a, b] if and only if 


[roa - [reas 


The next theorem translates this into a test that can be conveniently applied. 


Theorem 3.2.7 If f is bounded on [а, Б], then f is integrable on [а,Ь] if and only if 
for each € > 0 there is a partition P of [a, b] for which 


S(P) —s(P) < e. (3.2.19) 


Proof We leave it to you (Exercise 3.2.4) to show that if E f(x)dx exists, then (3.2.19) 
holds for ||P || sufficiently small. This implies that the stated condition is necessary for in- 
tegrability. To show that it is sufficient, we observe that since 


b “Ab 
s(P) < | OE | /(х)ах < 8(Р) 


for all P, (3.2.19) implies that 
ET b 
0x i foyax— f f(x) dx < є. 
a Ja 
Since e can be any positive number, this implies that 
ET b 
f f(x)dx = f f(x)dx. 
a a 


Therefore, f Н f (x) dx exists, by Theorem 3.2.5. a 


The next two theorems are important applications of Theorem 3.2.7. 
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Theorem 3.2.8 If f is continuous on [a, b], then f is integrable on [a, b]. 


Proof Let P = (xo, x1, ..., Xn} bea partition of [a, b]. Since f is continuous on [a, b], 
there are points c; and C in [x ;—1, Ху] such that 


fe; = Му = sup f(x) 


xj-15xXxj 


and 


inf f(x) 


Xj-1€xExj 


f) = т; 


(Theorem 2.2.9). Therefore, 


n 


S(P) – s(P) = Y [FE - FE] у — x-1). (3.2.20) 


j=1 


Since f is uniformly continuous on [a, b] (Theorem 2.2.12), there is foreach € > 0a > 0 
such that P 
Fœ- f< РЕР 
—a 
if x and x’ are in [a, b] and |x — x^| < 6. If || P|] < 6, then |c; —c’,| < ó and, from (3.2.20), 


S(P) — s(P) < к= Taj- xj) = є. 
j=l 


Hence, f is integrable on [a, b], by Theorem 3.2.7. m 
Theorem 3.2.9 If f is monotonic on [a, b], then f is integrable on [a, b]. 


Proof Let Р = (xo, х1,..., Xn} be a partition of [a, b]. Since f is nondecreasing, 


Роу) = М; = sum f(x) 


ху-1=х=хј 
апа 


S(xj-1) =m; = " inf — f(x). 


Hence, 
(Р) – (Р) = 3G) - f(2)6; —xj-)- 
j=l 
Since 0 < x; —xj-1 € ||P || and f(x;) — f(xj-1) = 9, 


S(P) - s(P) x |Р| у (70) – f(x; 


Ј=1 


= | PICO) – f@). 
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Therefore, 
S(P)-s(P)«e if |P|Cf(b) — f@) « e. 
so f is integrable on [a, b], by Theorem 3.2.7. 
The proof for nonincreasing f is similar. ш 
We will also use Theorem 3.2.7 in the next section to establish properties of the integral. 
In Section 3.5 we will study more general conditions for integrability. 


3.2 Exercises 


1. Complete the proof of Lemma 3.2.1 by verifying Eqn. (3.2.3). 
2. Show that if f is integrable on [a, b], then 


b b 
f f(x)dx =f f(x)dx. 
Ja a 
3. Prove: If f is bounded on [a, b], there is for each € > 0 a ô > 0 such that 


b b 
[тода = f fena - e eso 


if || P|| < 8. 
4. Prove: If f is integrable on [a,b] and € > 0, then S(P) — s(P) < e if ||P || is 
sufficiently small. HINT: Use Theorem 3.1.4. 


5. Suppose that f is integrable and g is bounded on [a, b], and g differs from f only 
at points in a set H with the following property: For each є > 0, Н can be covered 
by a finite number of closed subintervals of [a, b], the sum of whose lengths is less 
than e. Show that g is integrable on [a, b] and that 


QU dx — ” fo) dx. 
pee) 


HINT: Use Exercise 3.1.3. 


6. Suppose that g is bounded on [o, 8], and let Q : о = vo < vı < +--+ < vr, = В be 
a fixed partition of [a, В]. Prove: 


B L rB L BRI 
(а) f веда У | адас (Б) f вадаи = У | godu 
I £-1 Е ё=19 ж: 


7. А function f is of bounded variation оп [a, b] if there is a number К such that 


ve 


ve-1 


X |f@)- f@-)| < К 


j=1 
whenever a = ао < ау < ::: < аһ = b. (The smallest number with this property 
is the total variation of f on |a, b].) 
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8. 


9. 


10. 


(a) Prove: If f is of bounded variation on [a, b], then f is bounded on [a, b]. 
(b) Prove: If f is of bounded variation on [a,b], then f is integrable on [а, b]. 
HINT: Use Theorems 3.1.4 and 3.2.7. 


Let P = (xo, Xi, ..., Xn} be a partition of [a,b], co = xo = a, cg41 = Xn = b, 
and ху—1 € cj € xj, j = 1, 2,..., п. Verify that 


У CDE- 70-1) = &(5)f(0)-8(a) 70а) У /(ху)[е(су+1)—#(су)]. 


Ј=1 J=0 


Use this to prove that if T? f (x) dg(x) exists, then so does pM g(x)df (x), and 


b b 
f| swara = fsb) – sasa- [ foao. 
(This is the integration by parts formula for Riemann-Stieltjes integrals.) 


Let f be continuous and g be of bounded variation (Exercise 3.2.7) on [a, b]. 


(a) Show that if € > 0, there isa 5 > 0 such that |o — o'| < є/2 if o and o’ 
are Riemann-Stieltjes sums of f with respect to g over partitions P and P’ 
of [a,b], where P' is a refinement of P and ||P|| < 8. HINT: Use Theo- 
rem 2.2.12. 


(b) Let 8 be as chosen in (a). Suppose that оү and o» are Riemann-Stieltjes 
sums of f with respect to g over any partitions Р; and Р» of [a, b] with norm 
less than 6. Show that |o1 — o2| < є. 


(c) If > 0, let L(8) be the supremum of all Riemann-Stieltjes sums of f with 
respect to g over partitions of [a, b] with norms less than б. Show that L(6) is 
finite. Then show that L = lims_,94 L(6) exists. HINT: Use Theorem 2.1.9. 


(d) Show that Г f(x) dg(x) = L. 


Show that f. Р f (x) dg(x) exists if f is of bounded variation and g is continuous on 
[a, b]. HINT: See Exercises 3.2.8 and 3.2.9. 


3.8 PROPERTIES OF THE INTEGRAL 


We now use the results of Sections 3.1 and 3.2 to establish the properties of the integral. 
You are probably familiar with most of these properties, but not with their proofs. 


Theorem 3.3.1 Jf f and g are integrable on |a, b], then so is f + g, and 


[о + go) dx = [ fQ) dx + [ g(x) dx. 
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Proof Any Riemann sum of f + g over a partition P = (xo, X1, ..., Xn} of [a, b] can 
be written as 


Of+g = у, [/ (су) + £(cj)](x; = ху—1) 


j= 
=} (с) ху-1) + У aes) j —xj-1) 
j=l 

= Of + Og, 


J=1 


where of and og are Riemann sums for f and g. Definition 3.1.1 implies that if € > 0 
there are positive numbers 6; and 82 such that 


b 
os- | f(x)dx <£ if |P| <8 


and 


b 
o- f g(x) dx <£ if |P| < 82. 
a 


b b 
(s- Í лю) (n - Í юа) 


b 
Of -f f(x)dx 


If || P|| < = min(61,62), then 


b b 
opre- f feodx- | кодах) = 


a 


b 
Og -f g(x)dx 


= + 
є à € 
= — =є, 
2 2 
so the conclusion follows from Definition 3.1.1. ш 


The next theorem also follows from Definition 3.1.1 (Exercise 3.3.1). 


Theorem 3.3.2 If f is integrable on |а, b] and c is a constant, then cf is integrable 
on [a, b] and 


b b 
1 cf(x)dx = el f(x) dx. 
a a 
Theorems 3.3.1 and 3.3.2 and induction yield the following result (Exercise 3.3.2). 


Theorem 3.3.3 If fi, fo, ..., fn are integrable on [a,b] and c1, сә, ..., Cn are 
constants, then cy fi + C2 fo +-+- + сп Jn is integrable on |a, b] and 


b b b 
/ (cr fi + сә» +++: + en fa) dx = af Ai) dx +e f fa(x) dx 


b 
eu | fn (x) dx. 
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Theorem 3.3.4 If апа g are integrable on [a,b] and f(x) < g(x) fora < x x b, 
then 


b b 
[ fees = f g(x) dx. (3.3.1) 


Proof Since g(x) — f(x) 7 0, every lower sum of g — f over any partition of [a, b] is 
nonnegative. Therefore, 


b 
f С Л 


[ оа f. f(x)dx 


Hence, 


[ 


b 
| (g(x) — f(x) dx 
а (3.3.2) 


[ 


b 
f (g(x) — f(x) dx > 0, 


which yields (3.3.1). (The first equality in (3.3.2) follows from Theorems 3.3.1 and 3.3.2; 
the second, from Theorem 3.2.3.) [| 


Theorem 3.3.5 If f is integrable on [a, b], then so is | f |, and 
b 
| f(x)dx 


Proof Let P be a partition of [a, b] and define 


b 
<f | f(x)| dx. (3.3.3) 


Mj = sup { f(x) | xj-1 SRK 
mj =inf{ f(x) | xj- < x < xj}, 

M; = sup {| f(x)||xj-1 <x € xj]. 
m 


j = inf {| f()||xj-1 < x € ху}. 


Then EN 
M; —m; =зир{|/(х)|—|/(х)||ху—1 S x. x' € xj 
< sup {| f(x) — fE | xy-1 < x, a < xj] (3.3.4) 
= М – ту. 
Therefore, 


S(P) —s(P) x S(P) — s(P), 


where the upper and lower sums on the left are associated with | f | and those on the right are 
associated with f. Now suppose that e > 0. Since f is integrable on [a, b], Theorem 3.2.7 
implies that there is a partition P of [a, b] such that S(P) — s(P) « e. This inequality 
and (3.3.4) imply that S(P) — S(P) < e. Therefore, |f| is integrable on [a, b], again by 
Theorem 3.2.7. 


Since 


Хо) < 1700) ad —f@)slf@)|, azxzb, 
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Theorems 3.3.2 and 3.3.4 imply that 


b b b b 
| Уса = [rentas ma | rends = f irentas. 
which implies (3.3.3). [| 
Theorem 3.3.6 If f and g are integrable on [a, b], then so is the product fg. 


Proof We consider the case where f and g are nonnegative, and leave the rest of the 
proof to you (Exercise 3.3.4). The subscripts f, g, and fg in the following argument 
identify the functions with which the various quantities are associated. We assume that 
neither f nor g is identically zero on [a, 5], since the conclusion is obvious if one of them 
is. 


If P = (xo, X1,...,Xn} is a partition of [a, b], then 
n 
5у (P) – sgg(p) = У (Муу туву) — xj). (3.3.5) 
j=l 


Since f and g are nonnegative, Му. у; < Mf j Mg,j and M fg, j > m y, jmg,;. Hence, 
Mig — тє, S MEHMa o my me 
= (Myj—mpj)Mg;; + mpj(Mg,; = тај) 
< Mg(My; = ту) + My (Mg,j — mg,;), 


where My and Mg are upper bounds for f and g on [a,b]. From (3.3.5) and the last 
inequality, 


S yg (P) — syg (P) € Mg[S¢(P) — sp (P)] + My [Sg CP) — sgCP)]. (3.3.6) 


Now suppose that є > 0. Theorem 3.2.7 implies that there are partitions P, and P2 of 
[a, b] such that 


Sf (Pi) — sy (Pi) < 


€ 
TP and Se (Pa) — se (P2) < тур. (3.3.7) 


If Р is a refinement of both P, and Р», then (3.3.7) and Lemma 3.2.1 imply that 
€ € 
Sy(P)—sy(P) < 2M; and Sg£(P)—sg(P) < 2M; 
This and (3.3.6) yield 


€ € 
Sfe(P) - sg (P) <5 +5 =e 


Therefore, fg is integrable on [a, b], by Theorem 3.2.7. ш 
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Theorem 3.3.7 (First Mean Value Theorem for Integrals) Suppose that 
u is continuous and v is integrable and nonnegative on |a, b]. Then 


b b 
| u(x)v(x) dx = ио f u(x) dx (3.3.8) 
for some c in [а, b]. 


Proof From Theorem 3.2.8, и is integrable on [a, b]. Therefore, Theorem 3.3.6 implies 
that the integral on the left exists. If m = min {u(x) | а<х < b} and M = max {u(x) | a<x< b} 
(recall Theorem 2.2.9), then 
m<u(x)<M 
and, since v(x) > 0, 
mv(x) < u(x)v(x) x Mv(x). 


Therefore, Theorems 3.3.2 and 3.3.4 imply that 


b b b 
mf vends < f u(xyo(x)dx = М | v(x) dx. (3.3.9) 


This implies that (3.3.8) holds for any c in [a, b] if f? v(x) dx = 0. If f? v(x) dx # 0, 
let 


b 
f u(x)v(x) dx 
u= A (3.3.10) 


| u(x) dx 


Since /? v(x) dx > 0 in this case (why?), (3.3.9) implies that m < и < M, and the 
intermediate value theorem (Theorem 2.2.10) implies that 7 = u(c) for some c in [a, b]. 
This implies (3.3.8). E 


If v(x) = 1, then (3.3.10) reduces to 


1 b 
и = zl] u(x) dx, 


so T is the average of u(x) over [а,Ь]. More generally, if v is any nonnegative integrable 
function such that /? v(x) dx +Æ 0, then T in (3.3.10) is the weighted average of u(x) over 
la, b] with respect to v. Theorem 3.3.7 says that a continuous function assumes any such 
weighted average at some point in [a, 5]. 


Theorem 3.3.8 If f is integrable on [a,b] and a € a, < bı < b, then f is integrable 
on [a1, bı]. 


Section 3.3 Properties of the Integral 141 


Proof Supposethate > 0. From Theorem 3.2.7, there is a partition Р = (xo, х1,..., Xn} 
of [a, b] such that 


S(P) - s(P) = у) (Му - mj); – xj-1) < €. (3.3.11) 
Ј=1 


We may assume that a, and 5, are partition points of Р, because if not they can be inserted 
to obtain a refinement P’ such that S(P^) — s(P^) < S(P) — s(P) (Lemma 3.2.1). Let 
a, = xy and bı = xs. Since every term in (3.3.11) is nonnegative, 


У` Mj - mj) (xj - xj-1) < €. 


j=r+1 


Thus, Р = {xr, Xr+1,..., Xs} is a partition of [a1, 21] over which the upper and lower 
sums of f satisfy 
S(P) —s(P) « e. 


Therefore, f is integrable on [а1, bi], by Theorem 3.2.7. ш 


We leave the proof of the next theorem to you (Exercise 3.3.8). 


Theorem 3.3.9 If f is integrable on [а, b] and [b,c], then f is integrable оп |а, с], 
and 


є b c 
| f(x)dx = | f(x)dx + | f(x) dx. (3.3.12) 
a a b 
So far we have defined уб f (x) dx only for the case where о < В. Now we define 


[тоа --[ f(x) ах 


ifa < В, and 
| f(x) dx = 0. 


With these conventions, (3.3.12) holds no matter what the relative order of a, b, and c, 
provided that f is integrable on some closed interval containing them (Exercise 3.3.9). 


Theorem 3.3.8 and these definitions enable us to define a function F(x) = f. hi f (t) dt, 
where c is an arbitrary, but fixed, point in [a, 5]. 


Theorem 3.3.10 If f is integrable on [а,Ь] and a < c < b, then the function F 
defined by 


F(x) = f fdt 


satisfies a Lipschitz condition on |a, b], and is therefore continuous on [a, b]. 
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Proof If x and x’ are in [a, b], then 


ғо) ғо) = f soa- | ET [ tou. 


by Theorem 3.3.9 and the conventions just adopted. Since | f(t)| < K (a < t < b) for 


some constant K, 
x 
J ға) аг 
х! 


|F(x) — F(x’)| < К|х- х |, ахх, х <b. 


sK|x-x| a<x,x'<b 


(Theorem 3.3.5), so 


Theorem 3.3.11 If f is integrable on [a,b] anda € c < b, then F(x) = Pu f (t) dt 
is differentiable at any point xo in (a, b) where f is continuous, with F'(xo) = f(xo). If 
f is continuous from the right at a, then Е, (а) = f(a). If f is continuous from the left 
at b, then F! (b) = f(b). 


Proof We consider the case where a « xo « b and leave the rest to you (Exer- 


cise 3.3.14). Since 
1 


X — Хо 


f хо o 


we can write 


P0) PO у= 1 / FO- feo dr. 
х= Xo X — Хо J xo 


From this and Theorem 3.3.5, 


F(x) — F(xo) 


X — X0 


1 


|x — xol 


— f (xo) 


= 


: (3.3.13) 


| f FO- fea 


(Why do we need the absolute value bars outside the integral?) Since f is continuous at 
хо, there is for each e > 0a ó > O such that 


If) — f(xo)| «e if |x —xo| « ó 
and £ is between x and xo. Therefore, from (3.3.13), 


Е(х) – Е — 
EIST) ЖИ Zee aU ag if 0«|x —xo| < 8. 
0 


x—x |x — xol 


Hence, F'(xo) = f(xo). и 
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Example 3.3.1 If 


then the function 

x DE О<х<1, 

кө) = | foa- 12 
0 X 


— =l; 14x22; 
о xz 


is continuous on [0, 2]. As implied by Theorem 3.3.11, 


x — f(x), О<х=<1, 
Е'(х) = 
x+1= f(x), 1<x <2, 
= 279) _ 
F400) = ig, “DIS = lig, I = 0= 70, 


Е(х) = FQ). (x2/2) +x -1-3 
m —— = lim = 


F'(2)= li 
-Q) Peoi x—2 x2- x—2 
x+4 
uL ee 


F does not have a derivative at x = 1, where f is discontinuous, since 


F'(1 21 and Fj(1) =2. ш 
The next theorem relates integration and differentiation in another way. 


Theorem 3.3.12 Suppose that F is continuous on the closed interval [a, b] and dif- 
ferentiable on the open interval (a, b), and f is integrable on [a, b]. Suppose also that 


F'(x) = f(x), a«x«b. 


Then ; 
| f(x) dx = F(b) — F(a). (3.3.14) 
Proof If P = (xo, xi, ..., x4) is a partition of [a, b], then 
F(b) – F(a) = 3 `(Е(х;) - Ё(ху—\)). (3.3.15) 


Ј=1 
From Theorem 2.3.11, there is in each open interval (х; 1, ху) a point c; such that 


F(xj) — F(xj-1) = f(cj)(xj — xj). 
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Hence, (3.3.15) can be written as 
F(b) – F@) = У fs); —xj-1) = о, 
Ј=1 


where ø is a Riemann sum for f over Р. Since f is integrable оп [а, b], there is for each 
€ > 0aé > О such that 


b 
o- f f(x)dx| «e if ||P] <6. 


Therefore, 


«€ 


b 
Fo- ға) - | f(x)dx 


for every є > 0, which implies (3.3.14). ш 


Corollary 3.3.13 If f' is integrable on [a, b], then 
b 
| reas = f fo. 


Proof Apply Theorem 3.3.12 with F and f replaced by f and f", respectively. ш 
A function F is an antiderivative of f on [а, b] if F is continuous оп [a, b] and differ- 


entiable on (a, b), with 
F'(x) = f(x), a<x<b. 
If F is an antiderivative of f on [а,Ь], then so is F + c for any constant c. Conversely, 


if F; and Р are antiderivatives of f on [а,Ь], then F1 — ЕЁ» is constant on [a, b] (Theo- 
rem 2.3.12). Theorem 3.3.12 shows that antiderivatives can be used to evaluate integrals. 


Theorem 3.3.14 (Fundamental Theorem of Calculus) /f f is continu- 
ous on |a, b], then f has an antiderivative on [a, b]. Moreover, if F is any antiderivative 


of f on |a, b], then 
b 
| f(x)dx = F(b) — F(a). 


Proof The function Fo(x) = [И f (t) dt is continuous оп [a, b] by Theorem 3.3.10, 
and Р(х) = f(x) on (a, b) by Theorem 3.3.11. Therefore, Fo is an antiderivative of f 
on [а,Ь]. Now let F = Fo + c (c = constant) be an arbitrary antiderivative of f on [а, b]. 
Then 


b a b 
Fb) - F(a) = | feodx e c- | feodx-c = | f(x) dx. 
a a a m 
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When applying this theorem, we will use the familiar notation 


b 
F(b) — F(a) = F(x) 


a 


Theorem 3.3.15 (Integration by Parts) /f w' and v' are integrable on |a, b], 
then 
b 


b b 
| чод ах = ио (о) -f v(x)u'(x) dx. (3.3.16) 


a 


Proof Since u and v are continuous on [a, b] (Theorem 2.3.3), they are integrable on 
[a, b]. Therefore, Theorems 3.3.1 and 3.3.6 imply that the function 


(uv) = u'v + uv’ 


is integrable on [a, b], and Theorem 3.3.12 implies that 


b b 
I hrQ)v'G) + v G)vG9] dx = uawa), 


which implies (3.3.16). E 


We will use Theorem 3.3.15 here and in the next section to obtain other results. 


Theorem 3.3.16 (Second Mean Value Theorem for Integrals) Suppose 
that f' is nonnegative and integrable and g is continuous on |a, b]. Then 


b c b 
[ persed = fa | sadet so f водах (3317) 
for some c in [a, b]. 
Proof Since f is differentiable on [a,b], it is continuous on [а,Ь] (Theorem 2.3.3). 


Since g is continuous on [a, b], sois fg (Theorem 2.2.5). Therefore, Theorem 3.2.8 implies 
that the integrals in (3.3.17) exist. If 


G(x) = f g(t) dt, (3.3.18) 


then G'(x) = g(x), a < x < b (Theorem 3.3.11). Therefore, Theorem 3.3.15 withu = f 
and v = G yields 


b b b 
|. Fax = дво) -f f'(x)G(x) dx. (3.3.19) 


Since f’ is nonnegative and G is continuous, Theorem 3.3.7 implies that 


b b 
| f'x)G(x)dx = co f f'(x)dx (3.3.20) 
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for some c in [a, b]. From Corollary 3.3.12, 


b 
| f'G)dx = f(b) — fla). 


From this and (3.3.18), (3.3.20) can be rewritten as 


b c 
f f'G)GG) dx = (FO) — f(a) f &GO dx. 


Substituting this into (3.3.19) and noting that G(a) = 0 yields 


b b c 
f Flxe(x)dx = f(b) | g(x) dx — (0) — f (a) | «бй» 


с b a 
= f(a) f PTE ( f gG)dx — | sods) 


c b 
= f | g(x) dx + ro f g(x) dx. 


Change of Variable 
The following theorem on change of variable is useful for evaluating integrals. 


Theorem 3.3.17 Suppose that the transformation x = $(t) maps the interval с < 
t < d into the intervala € x € b, with¢(c) = a and ¢(d) = В, and let f be continuous 
on |a, b]. Let ф' be integrable on |c, d]. Then 


B d 
| (e | FOAL (t) at. (3.3.21) 


Proof Both integrals in (3.3.21) exist: the one on the left by Theorem 3.2.8, the one on 
the right by Theorems 3.2.8 and 3.3.6 and the continuity of f($(t)). By Theorem 3.3.11, 
the function 


Р(х) = ! fG)dy 


is an antiderivative of f on [a, b] and, therefore, also on the closed interval with endpoints 
a and В. Hence, by Theorem 3.3.14, 


B 
| f(x) dx = F(B) — F(a). (3.3.22) 


By the chain rule, the function 


G(t) = Е(ф(1)) 
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is an antiderivative of /(ф(1))ф' (t) on [c, d], and Theorem 3.3.12 implies that 


d 
f 70ф0))ф E) dt = G(d) — G(c) = Е(ф(а)) — Е(ф(с)) 
= F(B) — F(a). 
Comparing this with (3.3.22) yields (3.3.21). E 


Example 3.3.2 To evaluate the integral 
1/42 
I= f (1—2х?)(1 = x^) V? dx 
-1/V2 
we let 
Јо) = (= 2x7) = х2), -1//2xx 1/82, 
and 
x=¢(t)=sint, -л/4<1 < л/4. 
Then $'(t) = cost and 


1/42 л/4 
1 = / f(x)dx = f (sin t) cos t dt 
-1/2 4 (3.3.23) 
E | (1 —2sir? t)(1 — sin? t)-V? cos t dt. 
—л/4 


(1 — sin? 7)? = созт,—л/4 < t < 1/4 
and 


1—2sin?t = cos 2f, 


(3.3.23) yields 


Example 3.3.3 To evaluate the integral 


5л : 
t 
fs m ж 
o 2+cost 


we take f(t) = cost. Then $'(t) = — sint and 
zou QU yt ‚ 
" / 549094), fev 0d. 
where 


1 
f(x) = 24x 
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Therefore, since (0) = 1 and ф(5л) = —1, 
-1 


I Г a log(2 + x) log3 = 
= — = — 10 X = 10 . 
1 2x J 1 4 


These examples illustrate two ways to use Theorem 3.3.17. In Example 3.3.2 we evalu- 
ated the left side of (3.3.21) by transforming it to the right side with a suitable substitution 
x = ġ(t), while in Example 3.3.3 we evaluated the right side of (3.3.21) by recognizing 
that it could be obtained from the left side by a suitable substitution. 


The following theorem shows that the rule for change of variable remains valid under 
weaker assumptions on f if $ is monotonic. 


Theorem 3.3.18 Suppose that $' is integrable and $ is monotonic on |c, d], and the 
transformation x = $(t) maps |c, d] onto [a, b]. Let f be bounded оп |a, b]. Then 


gu) = /@())ф' @) 


is integrable on |c, d] if and only if f is integrable over |a, b], and in this case 
b d 
| оа = | леше enar. 


Proof We consider the case where f is nonnegative and ф is nondecreasing, and leave 
the the rest of the proof to you (Exercises 3.3.20 and 3.3.21). 


First assume that $ is increasing. We show first that 


ET ETI 
[гое | S(@(t))¢' (t) dt. (3.3.24) 


Let P = {to,t1,...,t,} be a partition of [c,d] and Р = (xo, x1, ..., Xn} with x; = $(t;) 
be the corresponding partition of [a, b]. Define 
U; = sup {p'O | tj-1 t Sty}, 
inf (9'(r) | tj- <t < tj}, 
M; = sup { f(x) | xj-1 <x T3212 


uj 


and 


M; —sup(f($(0)9 (0 | tj- <t < ty}. 
Since ф is increasing, и; > 0. Therefore, 
Osu; SPASU; улу 5150. 
Since f is nonnegative, this implies that 
0x f(6()u; < FOMO x FOMU, 1-1 5150). 


Therefore, 
Mju; < M; < MjUj, 
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which implies that 


M; = Муру, (3.3.25) 
where 
Now consider the upper sums 
n n 
S(P) 2M M; -tj-1) and S(P) = Y Mj(x; xj). (3.3.27) 
j=1 j=1 


From the mean value theorem, 
xj —Xj-1 = ф@;)—ф@)у-1) = P(E) — tj-1), (3.3.28) 
where tj—1 < Tj < tj, 80 
uj < ф (rj) < Оу. (3.3.29) 
From (3.3.25), (3.3.27), and (3.3.28), 


S(P) - S(P) =} Му(о;—ф'(т))@у —1у-а). (3.3.30) 
j=l 


Now suppose that | f(x)| < M,a < x < b. Then (3.3.26), (3.3.29), and (3.3.30) imply 
that 


n 
[S(P) - S(P)| M У (0; и) — tj-9- 
Ј=1 

The sum on the right is the difference between the upper and lower sums of ф' over Р. 
Since $' is integrable on [c, d], this can be made as small as we please by choosing || || 
sufficiently small (Exercise 3.2.4). 

From (3.3.28), || P|| < KIIPI if Ip | < K,c x t < d. Hence, Lemma 3.2.4 implies 
that 


F А Lo UE | Е 
sp) - | fG)dx| <É and sP- f FOO! @а <É 6331) 
if ||P || is sufficiently small. Now 
FE ar F o 
[ rœ- f f ($0) фа) а = | f(x) dx — 8(Р)| + |S(P) — ®(Р)| 


+ 


IM а 
S(P)- | FOMMHA dt 


Choosing Р so that |S(P) — S(P| < €/3 in addition to (3.3.31) yields 


= €. 


b d 
Í Jodi- | FODH ( dt 


Since e is an arbitrary positive number, this implies (3.3.24). 
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If ф is nondecreasing (rather than increasing), it may happen that ху; = х; for some 
values of j ; however, this is no real complication, since it simply means that some terms in 
S(P) vanish. 


By applying (3.3.24) to — f , we infer that 


b d 
f fdz = / FOPO dt, (3.3.32) 


since 

ET! b 

| &0cax e - [foa 
and Е 


а d 
f COOP 0) dt =- | FOP O dt. 


Now suppose that f is integrable on [a, b]. Then 


b “Ab b 
f уо) ах = | fdz = Í JG) dx, 
by Theorem 3.2.3. From this, (3.3.24), and (3.3.32), 
d nd b 
| уфа) (0d: = 1 FODH O dt = | fG) dx. 


This and Theorem 3.2.5 (applied to f(#(t))d’ (t)) imply that f($(t))9' (t) is integrable on 
[c,d] and 


b d 
[ одах [| уеже юа. (3.3.33) 
A similar argument shows that if f ($ (1))9' (t) is integrable on [с, d], then f is integrable 
on [a, b], and (3.3.33) holds. ш 


3.3 Exercises 


Prove Theorem 3.3.2. 
Prove Theorem 3.3.3. 


Can | f | be integrable on [a, b] if f is not? 


eS em 


Complete the proof of Theorem 3.3.6. HINT: The partial proof given above implies 
that if my and m» are lower bounds for f and g respectively on [a, b], then 
(f —mi)(g — т») is integrable on |a, b]. 


5. Prove: If f is integrable on [а,Ь] and | f (x)| > p > Ofora < x < b, then 1/f is 
integrable on [a, 5] 


10. 


11. 


12. 


13. 


14. 
15. 
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Suppose that f is integrable on [a, b] and define 


f(x) if f(x) 2 0, 
0 if f(x) <0, 


0 if f(x) > 0, 


+ i= 
f w=] f(x) if f(x) <0. 


and f (x)= | 
Show that f+ and f~ are integrable on [a, b], and 
b b b 
[ тое | reas | roar. 


Find the weighted average 7 of u(x) over [a, b] with respect to v, and find a point c 
in [a, b] such that u(c) = T. 
(a) u(x) = x, v(x) = х, [a,b] = [0,1] 
(b) u(x) = sinx, v(x) = х2, [a,b] =[-1, 1] 
(с) uix) ex^, v(x) = ех, [a,b] = [0,1] 
Prove Theorem 3.3.9. 
Show that 
c b c 
| feas | лодак | rends 
a a b 
for all possible relative orderings of a, b, and c, provided that f is integrable on a 
closed interval containing them. 
Prove: If f is integrable on [a, b] and a = ao < a1 < -++ < an = b, then 


ar 


кл 


ап—1 


[ toa f" feds + [fede 


Suppose that f is continuous on [a,b] and Р = (xo, x1, ..., хп} is a partition of 
[a, b]. Show that there is a Riemann sum of f over P that equals ГИ f(x) dx. 


Suppose that f’ exists and | f’(x)| < M on [а,Ь]. Show that any Riemann sum o 
of f over any partition P of [a, b] satisfies 


b 
o- f fG)dx| < Mb — а)|Р\. 


HINT: See Exercise 3.3.11. 

Prove: If f is integrable and f(x) > 0 on [a, b], then f f(x)dx > 0, with strict 
inequality if f is continuous and positive at some point in [a, b]. 

Complete the proof of Theorem 3.3.11. 


State theorems analogous to Theorems 3.3.10 and 3.3.11 for the function 


G(x) = f f(t) dt, 


and show how your theorems can be obtained from them. 
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16. Тһе symbol f f(x) dx denotes an antiderivative of f. A plausible analog of The- 
orem 3.3.1 would state that if f and g have antiderivatives on [a, b], then so does 
f + g, which is true, and 


[о 00x = | sonar | водах. (А) 


However, this is not true in the usual sense. 
(a) Why not? 
(b) State a correct interpretation of (A). 


17. (See Exercise 3.3.16.) Formulate a valid interpretation of the relation 


f (cf (x) dx = с | fG)dx (с £0). 


Is your interpretation valid if c = 0? 
18. (a) Let f+” be integrable on [a, b]. Show that 


а) r 1 n n n 
= У b-a +=. f FON — ry dt. 


r! 


HINT: Integrate by parts and use induction. 
(b) What is the connection between (a) and Theorem 2.5.5? 


19. In addition to the assumptions of Theorem 3.3.16, suppose that f(a) = 0, f # 0, 
and g(x) > 0 (a < x < Ё). Show that there is only one point c in [a, b] with the 
property stated in Theorem 3.3.16. HINT: Use Exercise 3.3.13. 


20. Assuming that Theorem 3.3.18 is true under the additional assumption that f is 
nonnegative on [a, b], show that it is true without this assumption. 


21. Assuming that the conclusion of Theorem 3.3.18 is true if ф is nondecreasing, show 
that it is true if @ is nonincreasing. HINT: Use Exercise 3.1.6. 


22. Suppose g' is integrable and f is continuous on [a, b]. Show that /? f (x) dg(x) 
exists and equals y? Р(х) (x) dx. 


23. Suppose f and g” are bounded and fg’ is integrable on [a, b]. Show that /? f (x) dg(x) 
exists and equals /? f (x)g' (x) dx. HINT: Use Theorem 2.5.4. 


3.4 IMPROPER INTEGRALS 


So far we have confined our study of the integral to bounded functions on finite closed 
intervals. This was for good reasons: 


e From Theorem 3.1.2, an unbounded function cannot be integrable on a finite closed 
interval. 


Section 3.4 Improper Integrals 153 


e Attempting to formulate Definition 3.1.1 for a function defined on an infinite or semi- 
infinite interval would introduce questions concerning convergence of the resulting 
Riemann sums, which would be infinite series. 


In this section we extend the definition of integral to include cases where f is unbounded 
or the interval is unbounded, or both. 


We say f is locally integrable on an interval J if f is integrable on every finite closed 
subinterval of Т. For example, 


f(x) = sinx 


is locally integrable on (—оо, оо); 


1 
6 7 татр 


is locally integrable on (—oo, 0), (0, 1), and (1, оо); and 
h(x) = ух 


is locally integrable on [0, оо). 


Definition 3.4.1 If f is locally integrable on [a, b), we define 


b c 
Í f(x)dx — Jim f f(x)dx (3.4.1) 


if the limit exists (finite). To include the case where b — oo, we adopt the convention that 
00— = oo. ш 


The limit in (3.4.1) always exists if [a, b) is finite and f is locally integrable and bounded 


on [a, b). In this case, Definitions 3.1.1 and 3.4.1 assign the same value to I f(x) dx no 
matter how f(b) is defined (Exercise 3.4.1). However, the limit may also exist in cases 
where b = co or b « co and f is unbounded as x approaches b from the left. In these 
cases, Definition 3.4.1 assigns a value to an integral that does not exist in the sense of Def- 


inition 3.1.1, and f E f (x) dx is said to be an improper integral that converges to the limit 
in (3.4.1). We also say in this case that f is integrable on |a, b) and that ГИ f (x) dx exists. 
If the limit in (3.4.1) does not exist (finite), we say that the improper integral T f(x)dx 
diverges, and f is nonintegrable on |a, b). In particular, if lime—>p— ГА f(x)dx = +оо, 
we say that /? f (x) dx diverges to +оо, and we write 


2 b 
f fed or | fend = = 


whichever the case may be. 


Similar comments apply to the next two definitions. 
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Definition 3.4.2 If f is locally integrable on (a, b], we define 


b b 
| f(x)dx = Jim. f f(x)dx 


provided that the limit exists (finite). To include the case where a — —oo, we adopt the 
convention that —oo-- = —oo. 


Definition 3.4.3 If f is locally integrable on (a, b), we define 


b a b 
| тода = | лода + | fena. 
а а Q 
where a < a < b, provided that both improper integrals on the right exist (finite). ш 


The existence and value of f id f (x) dx according to Definition 3.4.3 do not depend on 
the particular choice of o in (a, b) (Exercise 3.4.2). 


When we wish to distinguish between improper integrals and integrals in the sense of 
Definition 3.1.1, we will call the latter proper integrals. 


In stating and proving theorems on improper integrals, we will consider integrals of 
the kind introduced in Definition 3.4.1. Similar results apply to the integrals of Defini- 
tions 3.4.2 and 3.4.3. We leave it to you to formulate and use them in the examples and 
exercises as the need arises. 


Example 3.4.1 The function 


1 1 
f(x) = 2x sin — — cos — 
x x 


is locally integrable and the derivative of 
21 
F(x) = x^sin— 
x 


on [—2/х,‚ 0). Hence, 


[4 


Il 
= 
A, 
5 
| 


f(x)dx 2 


—2/л x 


and 


0 
f(x)dx = lim б m + =) = E 
—2/л c>0- c n? л? 
according to Definition 3.4.1. However, this is not an improper integral, even though /(0) 
is not defined and cannot be defined so as to make f continuous at 0. If we define f(0) 
arbitrarily (say f(0) = 10), then f is bounded on the closed interval [—2 /л, 0] and con- 
tinuous except at 0. Therefore, /°, js Р(х) dx exists and equals 4/7? as a proper integral 

(Exercise 3.4.1), in the sense of Definition 3.1.1. 
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Example 3.4.2 The function 


Хо) = (1-х)? 
is locally integrable ор [0, 1) and, if p = 1 and0 < c < 1, 
с ]—x)y?* J|? l—c)yPti_] 
Í (ix) bd pc MEET. EE а Жарды! 
0 р-1 fo p=! 
Hence, 
c > —1 
lim | a- ds - [C Bir quide 
c—1-— Јо оо, р> 1. 
For р = 1, 
с 
іт Í (1— x)! dx = — lim log(1 —c) = оо. 
c>1- Јо c—1— 
Hence, 
1 -1 
= (1-р), pxl, 
мүр ду 
fa x)? dx S sei 


Example 3.4.3 The function 
Јо) =x? 
is locally integrable on [1, oo) and, if p Z 1 and c > 1, 
с —p+1 
/ х7? dx = Ž 
1 


иаа! 


—р+1\| =р+1 
Hence, 
с — 
lim x? dx = (p-D'. р>1, 
c> Jy OQ, p< 1. 
For p = 1, 
с 
lim x ldx = lim loge = oo. 
соо 1 с->со 
Непсе, 
oo = 
x Рах = (p — 1) Y р> 1, 
1 oo, р < 1. 


Example 3.4.4 If 1 < c < оо, then 


[4] 


aa | 1 Ex 1 5 1 2 
— log — dx = — —logx dx = —-(logx) | = – = (logc). 
1 xX x 1x 2 1 2 


Hence, 


so 
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Example 3.4.5 The function f(x) = cos x is locally integrable on [0, 00) and 
[4 


lim cosx dx — lim sinc 
£—o00 0 g—koo 


does not exist; thus, i cos x dx diverges, but not to +оо. 


Example 3.4.6 The function f(x) = log x is locally integrable on (0, 1], but un- 
bounded as x — 0+. Since 


1 
=—1— li 1 —c)=-l, 
lim, ogc —c) 


1 


li 1 dx = li 1 — 
lm : орх dx lim, (х Og x — x) 


с 


Definition 3.4.2 yields 


1 
f logx dx = —1. 
0 


Example 3.4.7 In connection with Definition 3.4.3, it is important to recognize that 


the improper integrals /* f(x) dx and f li f(x) dx must converge separately for |] E f(x) dx 
to converge. For example, the existence of the symmetric limit 


R 
lim f f(x) dx, 
R->0oo —R 


which is called the principal value of [25 f (x) dx, does not imply that f^, f(x) dx 


converges; thus, 
R 


lim xdx = lim 0 = 0, 
Roo J_R Roo 
but /у x dx and Lum x dx diverge and therefore so does [°S x dx. 


Theorem 3.4.4 Suppose that fi, f2,..., fn are locally integrable on [a, b) and that 
ГИ AG) dx, f f(x) dx, ..., f ЛҺ(х) ах converge. Let c1, со, ..., Cn be constants. 
Then ICI + ea fi +: Cn fn)(x) dx converges and 


[es ea fa E + Cn fia) dx = [лодае f љода 
ee [лодак 
Proof Іа «c < Б, then 
[ел + сә» ++ Cn fox) dx =a [лодае f љода 


Hoten f љода, 


by Theorem 3.3.3. Letting c — b— yields the stated result. E 
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Improper Integrals of Nonnegative Functions 


The theory of improper integrals of nonnegative functions is particularly simple. 


Theorem 3.4.5 If f is nonnegative and locally integrable on [a, b), then /? f(x) ах 
converges if the function 


ко) = | f(t) dt 


is bounded on [a, b), and JT f (x) dx = oo if it is not. These are the only possibilities, and 


b 
| f(t) dt = sup F(x) 


a<x<b 


in either case. 


Proof Since F is nondecreasing on [a, b), Theorem 2.1.9(a) implies the conclusion. 
a 


We often write 


b 
f f(x)dx < œ 


to indicate that an improper integral of a nonnegative function converges. Theorem 3.4.5 
justifies this convention, since it asserts that a divergent integral of this kind can only di- 


verge to oo. Similarly, if f is nonpositive and f. E f (x) dx converges, we write 


b 
f f(x)dx > —oo 


because a divergent integral of this kind can only diverge to —oo. (To see this, apply 
Theorem 3.4.5 to — f.) These conventions do not apply to improper integrals of functions 
that assume both positive and negative values in (a,b), since they may diverge without 
diverging to +оо. 


Theorem 3.4.6 (Comparison Test) If f and g are locally integrable on [a, b) 
and 


0< f(x)zg(x) a<x<b, (3.4.2) 
then 

b b 
(a) | f(x)dx «oo if | g(x)dx « oo 
and 


b b 
(b) [ seax=00 if | fed = о 
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Proof (a) Assumption (3.4.2) implies that 


f roas f soa a<x<b 


a 


(Theorem 3.3.4), so 


sup [ f(t)dt < sup f g(t) dt. 


axx«b a<x<b 
If f ij g(x) dx < oo, the right side of this inequality is finite by Theorem 3.4.5, so the left 
side is also. This implies that ГИ f (x) dx < oo, again by Theorem 3.4.5. 
(b) The proof is by contradiction. If f g(x) dx < oo, then (a) implies that /? f(x)dx < 
оо, contradicting the assumption that /? f(x)dx = oo. ш 
The comparison test is particularly useful if the integrand of the improper integral is 


complicated but can be compared with a function that is easy to integrate. 


Example 3.4.8 The improper integral 
I -f жар 
o (1—-x)? 


2 + sinzx 3 
CAM e < 
(=й gem "= 


converges if p « 1, since 
0< 


and, from Example 3.4.2, 


However, J diverges if p > 1, since 


1 2 + алх 
0 < ———— < — —, 0<x<l, 
(1— x)? (1 — x)? 
and 
[ dx _ - ‘a 
Жар ЖА РЕ 


If f is any function (not necessarily nonnegative) locally integrable on [a, 5), then 
[5 а č 
| (eds | годах | годах 
а а а 


if a; and c аге ір [a, b). Since d. f (x) dx is a proper integral, on letting c — b— we 


conclude that if either of the improper integrals f. М f(x) dx and 1 f(x) dx converges 
then so does the other, and in this case 


[ foa |" позах | feos 
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This means that any theorem implying convergence or divergence of an improper integral 


J. А f (x) dx in the sense of Definition 3.4.1 remains valid if its hypotheses are satisfied 
on a subinterval [a1, b) of [a, b) rather than on all of [a, b). For example, Theorem 3.4.6 
remains valid if (3.4.2) is replaced by 


0x f(x) < g(x), ахх <, 


where a, is any point in [а, b). 

From this, you can see that if f(x) > 0 on some subinterval [ai, b) of [a, Б), but not 
necessarily for all x in [a, b), we can still use the convention introduced earlier for positive 
functions; that is, we can write f E f(x)dx « oo if the improper integral converges or 


р (x) dx = oo if it diverges. 
Sa f 8 


Example 3.4.9 If p > 0, then 


= ET А 
x Е (х — 1)2(2 + sin х) 2 


ЭИ ар 
2 Q- ^7 


for x sufficiently large. Therefore, Theorem 3.4.6 and Example 3.4.3 imply that 


T (x — 1)? (2 + sin x) 
1 


бср. e 


converges if p > 1 or diverges if p < 1. 


Theorem 3.4.7 Suppose that f and g are locally integrable on [а, b), g(x) > 0 and 
f(x) = 0 on some subinterval [а1, b) of [a, b), and 


F(x) _ 
er g(x) =н 


(3.4.3) 


(а) If0 <M < оо, then J f(x)dx and I g(x) dx converge or diverge together. 
(b) If M = co and f? g(x) dx = oo, then f f(x)dx = oc. 
(c) If M 20 and f? g(x) dx « oo, then p f(x) dx < oo. 


Proof (a) From (3.4.3), there is a point a2 in [а1, b) such that 


M f(x) 3M 
< — < 


0 =n a 
2 Ё g(x) 2 


<x <b, 


a» 


and therefore 3 T 
5480) « f(x) « =z 8), d) < х <b. (3.4.4) 
Theorem 3.4.6 and the first inequality in (3.4.4) imply that 
b b 
| g(x)dx «oo if | f(x) dx < oo. 
a a2 


2 
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Theorem 3.4.6 and the second inequality in (3.4.4) imply that 


b b 
|. fed <o т f бах e oc. 


2 


Therefore, f D f(x) dx and f H g(x)dx converge or diverge together, and in the latter case 
they must diverge to oo, since their integrands are nonnegative (Theorem 3.4.5). 


(b) If M = œ, there is a point a2 in [a1, b) such that 
f(x) > а(х), а <х 56, 


so Theorem 3.4.6(b) implies that /? f(x)dx = оо. 
(c) If M = 0, there is a point a2 in [а1, b) such that 


Хх) < (х), a»zxzb, 


so Theorem 3.4.6(a) implies that T f(x) dx < oo. п 
The hypotheses of Theorem 3.4.7 (b) and (c) do notimply that f. E f(x) dx and f is g(x) dx 
necessarily converge or diverge together. For example, if b = oo, then f(x) = 1/x 


and g(x) — 1/x? satisfy the hypotheses of Theorem 3.4.7(b), while f(x) — 1/x? and 
g(x) = 1/x satisfy the hypotheses of Theorem 3.4.7(c). However, d 1/xdx = oo, 
while f?" 1/x? dx < оо. 


Example 3.4.10 Let f(x) = (1 + x)? and g(x) = x^. Since 


ion 
е g(x) =! 


апа 2 x^? dx converges if р > 1 or diverges if p < 1 (Example 3.4.3), Theorem 3.4.7 
implies that the same is true of 


[а +x)? ах. 
1 


Example 3.4.11 The function 
Јо) 2x *ü-xy* 
is locally integrable on (0, oo). To see whether 
oo 
І = f x P(1- x) ? dx 
0 


converges according to Definition 3.4.3, we consider the improper integrals 


1 oo 
lh = f x "(1--x)?dx and h = / x P(1+x)%dx 
0 1 
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separately. (The choice of 1 as the upper limit of 7, and the lower limit of /2 is completely 
arbitrary; any other positive number would do just as well.) Since 


im 2 = mata 1 
x04 x P x04 
and i 
EP 
| ee е 
0 со, р> 1, 


Theorem 3.4.7 implies that 7, converges if and only if p < 1. Since 


F(x) 


x—oo x P—4 


= іа (1+ х) x? = 1 
х->со 


[хт ы ттеу езше, 

1 oo, p+qsl, 

Theorem 3.4.7 implies that /5 converges if and only if p + q > 1. Combining these 
results, we conclude that 7 converges according to Definition 3.4.3 if and only if p « 1 
and p 4- q > 1. 


Absolute Integrability 


Definition 3.4.8 We say that f is absolutely integrable on [a, b) if f is locally inte- 


grable on [a, b) and /? | f (x)| dx < oo. In this case we also say that /? f (x) dx converges 
absolutely or is absolutely convergent. 


Example 3.4.12 If f is nonnegative and integrable on [a,b), then f is absolutely 
integrable on [a, b), since | f| = f. 


Example 3.4.13 Since 
1 


= XP 


and T x ? dx « ooif p > 1 (Example 3.4.3), Theorem 3.4.6 implies that 
ess 
] [Б dx<oo, p> l; 
1 


that is, the function 


xP 
is absolutely integrable on [1, оо) if p > 1. It is not absolutely integrable on [1, оо) if 


p < 1. To see this, we first consider the case where p = 1. Let К be an integer greater 
than 3. Then 
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f | sin x| d [ | sin x| d 
——dx > ——— dx 
1 x л x 


E pti | sin x| 
= у] — — dx (3.4.5) 
J 


i x 


k—1 


1 (/+10)л 
> Gaba | | sin x| dx. 
J Л Јјл 


Ви 
G-t1)x л 

f ахх f sinx dx = 2, 
j 0 


so (3.4.5) implies that 


Кл ; = 

2 1 

| Euri PEN a, (3.4.6) 
1 x "d +1 


However, 


so (3.4.6) implies that 


i. | sin x| 2 S dx 
E S шш = 
1 x л < х 


Ј 


-2 | 
=>} 


Since limk—>oo log[(k + 1)/2] = оо, Theorem 3.4.5 implies that 


90 |sinx| 
dx — oo. 
= 


Now Theorem 3.4.6(b) implies that 


j=1 
k+1 
Zh- = 


j+1 
dx 2 k+1 
X x 2 


°° | sin x| 
—dx=o, p<l. (3.4.7) 
1 xP 


Theorem 3.4.9 If f is locally integrable on [a, b) and ГЫ | f(x)|dx < oo, then 


Jj f (x) dx converges; that is, an absolutely convergent integral is convergent. 


Proof If 
g(x) = |f@)| Р(х), 


Section 3.4 Improper Integrals 163 


then 
0x g(x) = 2[f(x)| 


and f E g(x) dx < оо, because of Theorem 3.4.6 and the absolute integrability of f. Since 
Fel 


Theorem 3.4.4 implies that f. Р f (x) dx converges. ш 


Conditional Convergence 


We say that f is nonoscillatory at b— (= оо if b = оо) if f is defined on [а, b) and 
does not change sign on some subinterval [a1, b) of [a, b). If f changes sign on every 
such subinterval, f is oscillatory at b—. For a function that is locally integrable on [a, b) 
and nonoscillatory at b—, convergence and absolute convergence of f i f(x) dx amount 
to the same thing (Exercise 3.4.16), so absolute convergence is not an interesting concept 
in connection with such functions. However, an oscillatory function may be integrable, 
but not absolutely integrable, on [a, b), as the next example shows. We then say that f is 


conditionally integrable on [a, b), and that f. P f(x) dx converges conditionally. 


Example 3.4.14 We saw in Example 3.4.13 that the integral 


1) = | sin x dx 
1 


xP 


is not absolutely convergent if0 < p < 1. We will show that it converges conditionally for 
these values of p. 


Integration by parts yields 


€ sinx — cosc © cos x 
dx — + cosl— p — dx. (3.4.8) 
1 1 X 


xP cP 


Since 


COS X 1 
< ——— 
T | — xrt*1 
and Rh x ?-!dx < oo if p > 0, Theorem 3.4.6 implies that x 7^! cos x is absolutely 


integrable [1, оо) if p > 0. Therefore, Theorem 3.4.9 implies that x 7^! cos x is integrable 
[1, 00) if p > 0. Letting c — oo in (3.4.8), we find that 7(p) converges, and 


Қр) = cos 1 Т МИК. df pee 
(р) = cos =P] рн x if p»0. 


This and (3.4.7) imply that /(р) converges conditionally if 0 < p < 1. " 


The method used in Example 3.4.14 is a special case of the following test for convergence 
of improper integrals. 
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Theorem 3.4.10 (Dirichlet’s Test) Suppose that f is continuous and its an- 
tiderivative F(x) = /* /@) dt is bounded on |a, b). Let g' be absolutely integrable on 
la, b), and suppose that 
lim g(x) = 0. (3.4.9) 
x—b— 


Then /? f (x)g(x) dx converges. 


Proof The continuous function fg is locally integrable on [a, Р). Integration by parts 
yields 


f f(x)g(x) dx = F(c)g(c) — f F(x)g(x)dx, a<c<b. (3.4.10) 


Theorem 3.4.6 implies that the integral on the right converges absolutely as с > b—, since 
/? |g’(x)| dx < оо by assumption, and 


[Е(х)в'(х)| < М|в'(х)|, 


where M is an upper bound for | F| on [a, b). Moreover, (3.4.9) and the boundedness of F 
imply that lim,_,,- F(c)g(c) = 0. Letting с > b— in (3.4.10) yields 


b b 
f St (x)g(x) dx = -f F(x)g' (х) dx, 


a 
where the integral on the right converges absolutely. ш 


Dirichlet's test is useful only if f is oscillatory at b—, since it can be shown that if f is 


nonoscillatory at b— and F is bounded on [a, b), then f | f(x)g(x)| dx < oo if only g is 
locally integrable and bounded on [a, b) (Exercise 3.4.14). 


Example 3.4.15 Dirichlet’s test can also be used to show that certain integrals di- 


verge. For example, 
оо 
| x? sinx dx 
1 


diverges if q > 0, but none of the other tests that we have studied so far implies this. It 
is not enough to argue that the integrand does not approach zero as x — oo (a common 
mistake), since this does not imply divergence (Exercise 4.4.31). To see that the integral 
diverges, we observe that if it converged for some g > 0, then F(x) = I x? sin x dx 
would be bounded on [1, 00), and we could let 


f(x) =x%sinx and g(x)=x 4% 


in Theorem 3.4.10 and conclude that 


oo 
| sinx dx 
1 


also converges. This is false. ш 
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The method used in Example 3.4.15 is a special case of the following test for divergence 
of improper integrals. 


Theorem 3.4.11 Suppose thatu is continuous on [a, b) and /? u(x) dx diverges. Let 
v be positive and differentiable on |a, b), and suppose that limy 5р v(x) = oo and v'/v? 


is absolutely integrable on [a, b). Then f u(x)v(x) dx diverges. 


Proof The proof is by contradiction. Let f = uv and g = 1/v, and suppose that 


D Н u(x)v(x) dx converges. Then f has the bounded antiderivative F(x) = f, Е u(t)u(t) dt 
on [a, b), limy+oo g(x) = 0 and а” = —v’/v? is absolutely integrable on [а, b). Therefore, 
Theorem 3.4.10 implies that f 4 u(x) dx converges, a contradiction. ш 


If Dirichlet's test shows that f M f (x)g(x) dx converges, there remains the question of 
whether it converges absolutely or conditionally. The next theorem sometimes answers this 
question. Its proof can be modeled after the method of Example 3.4.13 (Exercise 3.4.17). 
The idea of an infinite sequence, which we will discuss in Section 4.1, enters into the 
statement of this theorem. We assume that you recall the concept sufficiently well from 
calculus to understand the meaning of the theorem. 


Theorem 3.4.12 Suppose that g is monotonic on [a, b) and /? g(x) dx = oo. Let f 
be locally integrable on [a, b) and 


Xj41 . 
f |f(x)dxzp, jz0. 
xj 


or some positive p, where {x ;! is an increasing infinite sequence of points in |a, b) such 
р р Ј 8 q p 
that limj—+oo x; = b and xj41 — xj € M, j > 0, for some M. Then 


b 
f |f и [йк — 5o. 


Change of Variable in an Improper Integral 


The next theorem enables us to investigate an improper integral by transforming it into 
another whose convergence or divergence is known. It follows from Theorem 3.3.18 and 
Definitions 3.4.1, 3.4.2, and 3.4.3. We omit the proof. 


Theorem 3.4.13 Suppose that ф is monotonic and ф' is locally integrable on either 
of the half-open intervals I = [c, d) or (c, d], and let x = $(t) map I onto either of the 
half-open intervals J = [a, b) or J = (a,b]. Let f be locally integrable on J. Then the 
improper integrals 


b d 
f fdk xd f f (60) d (| d 
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diverge or converge together, in the latter case to the same value. The same conclusion 
holds if $ and ф' have the stated properties only on the open interval (a, Б), the transfor- 
mation x = ф(1) maps (c, d) onto (a, b), and f is locally integrable on (a, Б). 


Example 3.4.16 To apply Theorem 3.4.13 to 


oo 
f sinx? dx, 
0 


we use the change of variable x = $(t) = \/f, which takes [c, d) = [0, oo) into [a, b) = 
[0, оо), with ф/(ї) = 1/(24/t). Theorem 3.4.13 implies that 


| sinx? dx = — SI dh 
0 2 0 Jt 


Since the integral on the right converges (Example 3.4.14), so does the one on the left. 


/ x? dx 
1 


converges if and only if p > 1 (Example 3.4.3). Defining ¢(¢) = 1/t and applying 
Theorem 3.4.13 yields 


oo 1 1 
f x? dx f "i-e f (P7? dt, 
1 0 0 


which implies that 2 14 dt converges if and only if q > —1. 


Example 3.4.17 The integral 


3.4 Exercises 


1. (a) Let f be locally integrable and bounded on [a, b), and let f(b) be defined 
arbitrarily. Show that f is properly integrable on [a, b], that f Р f (x) dx does 
not depend on / (b), and that 


b с 
| f(x)dx = lim f f(x)dx. 
a cb— Ja 
(b) State a result analogous to (a) which ends with the conclusion that 
b b 
| f(x)dx = lim f f(x) dx. 
a cat Je 


2. Show that neither the existence nor the value of the improper integral of Defini- 
tion 3.4.3 depends on the choice of the intermediate point о. 
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Prove: If /? f (x) dx exists according to Definition 3.4.1 or 3.4.2, then /? f(x)dx 
also exists according to Definition 3.4.3. 


Find all values of p for which the following integrals exist (i) as proper integrals 
(perhaps after defining f at the endpoints of the interval) or (ii) as improper inte- 
grals. (iii) Evaluate the integrals for the values of p for which they converge. 


(c) | es (a) f a T NECS | spas 


Evaluate 


(a) f ee (п = 0,1,...) (b) [| ess 
0 0 
? хах 1 хах 
d NISI 
of үз of- 


T /cosx sinx 00 /sinx | cosx 
— d f ——|4 
e (к) as of (S]a 


Prove: If f Hi f(x)dx exists as a proper or improper integral, then 


b 
im f f(t) dt =0. 


Prove: If f is locally integrable on [a, b), then /? f (x) dx exists if and only if for 
each e > 0 there is a number r in (a, b) such that 


[ f(t) dt 


whenever r < x1, x2 < b. HINT: See Exercise 2.1.38. 


«€ 


Determine whether the integral converges or diverges. 


90 logx + sinx (x? + 33/2 
(a) | ee (b * Gap? sin? x dx 
1 + cos? x 0 © 4 + cos x 
(£ f re (a) f TEN d 


(e) Ip + sinx)e * dx (£) [хо + sin х) dx 
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9. 


10. 


11. 


12. 


13. 


14. 


15. 


Find all values of p for which the integral converges. 


л/2 sin x 7/2 cos x со 
р„—Х 
(a) | TX ax (b) f oe dx о f awda 


sin x 09 ах 1 ах 
e (^ (апу)? 7" ej x (log x)? el x(logx]? 


xdx 
(g XN (sin x)? 


Let L,(x) be the iterated logarithm defined in Exercise 2.4.42. Show that 


E dx 

а Lo(x)Li(x) -: Le) [Legi (x)]? 

converges if and only if p > 1. Here a is any number such that куу (х) > 0 for 
x >а. 


Find conditions on p and q such that the integral converges. 


: 1 
(a) -1 — dx (b) L (1—х)?(1+ х)“ ах 
y а, [log(1 + x)]? (log 3 
P 4 (xy n I == 
(е) | М = КАЕ A (ean y 


Let f and g be polynomials and suppose that g has no real zeros. Find necessary 
and sufficient conditions for convergence of 


59 f(x) РИ 
-œ g(x) 


Prove: If f and g are locally integrable on [a, b) and the improper integrals f. f(x) dx 
and f Р g?(x) dx converge, then f, E f (x)g(x) dx converges absolutely. HINT: (f + 
g? zo. 


Suppose that f is locally integrable and F(x) = f a F(t) dt is bounded on [a, b), 
and let f be nonoscillatory at b—. Let g be locally integrable and bounded on [a, b). 
Show that 


b 
f лов 00) ах < oo. 


Suppose that g is positive and nonincreasing оп [a, b) and f f(x)dx exists as 


a proper or absolutely convergent improper integral. Show that / и F(x)g(x) dx 
exists and 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 
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tin ces лова =o. 


HINT: Use Exercise 3.4.6. 

Show that if f is locally integrable on [a, b) and nonoscillatory at b—, then f. Р f(x)dx 
exists if and only if /? | f(x)| dx < оо. 

(a) Prove Theorem 3.4.12. HINT: See Example 3.4.13. 


(b) Show that g satisfies the assumptions of Theorem 3.4.10 if g’ is locally inte- 
grable, g is monotonic on [a, b), and іт, 5р g(x) = 0. 


Find all values of p for which the integral converges (i) absolutely; (ii) condition- 
ally. 


00 cos x sin x sin x 
(a) | xP gs (b Rr x(log x)? Жол е d fr xP logx ^ 


(d) [С snes dx (Е | sin? x sin 2x xsin2x , ax (f) [ sin x 


oo (1+ +x 4 


Suppose that g” is absolutely integrable on ^ оо), шту оо g'(x) = 0, and limx—>oo g(x) = 


L (finite or infinite). Show that [en g(x) sin x dx converges if and only if L = 0. 
HINT: Integrate by parts. 


Let Л be continuous on [0, oo). Prove: 


a) If [2° e-*h(x) dx converges absolutely, then [2° e~*h(x) dx converges 
0 5 y 0 5 
absolutely if s > so. 


(b) If le e 30* h(x) dx converges, then he e ** h(x) dx converges if s > so. 


Suppose that f is locally integrable on [0, оо), limy+oo f(x) = A, anda > —1. 
Find limy-554 x 7^! do. f (t)t* dt, and prove your answer. 


Suppose that f is continuous and F(x) — ГА f (t) dt is bounded on [а, b). Suppose 
also that g > 0, г” is nonnegative and locally integrable on [a, b), and іт, р g(x) = 
oo. Show that 


E up ah fe@dt =0, р>1. 


HINT: Integrate by parts. 


In addition to the assumptions of Exercise 3.4.22, assume that f. E f (t) dt converges. 


Show that А 7 
lim | t)g(t) dt — 0. 
Esel /@)в( 


HINT: Let F(x) = T f (t) dt, integrate by parts, and use Exercise 3.4.6. 
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24. 


25. 


26. 


Suppose that f is continuous, g'(x) < 0, and g(x) > 0 on [a, b). Show that if g” is 
integrable on [a, b) and /? f (x) dx exists, then f f (x)g(x) dx exists and 


i cd. v 
Jim cuf fosa o. 


HINT: Let F(x) — /? f (t) dt, integrate by parts, and use Exercise 3.4.6. 


Find all values of p for which the integral converges (i) absolutely; (ii) condition- 
ally. 


1 1 oo 
(a) / x? sin 1/x dx (b f | log х]? dx ©) | x? cos(log x) dx 
0 0 1 


oo oo 
(d) / (log x)? dx (e) f sinx? dx 
1 0 
Let иј be positive and satisfy the differential equation 


и” + р(х)и = 0, 0xx«oo. (A) 


ra dx p 
оо, 
0 uz (x) 
? dt 
ит@) 


ru dx 
== оо, 
0 uj (x) 


dt 
ит@) 


(a) Prove: If 


then the function 


u»(x) = ma) f 


also satisfies (A), while if 


then the function 


por nica) f 


also satisfies (A). 


(b) Prove: If (A) has a solution that is positive on [0, oo), then (A) has solutions 
yı and y» that are positive on (0, оо) and have the following properties: 


у1(х)у(х) – yx160y2() = 1, x » 0, 


у(х) 
E < 0, x»0, 


and 
m Л? _ 0 
хоо у(х) 
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27. (а) Prove: If h is continuous on [0, oo), then the function 
x 
u(x) = ce х + се“ + f h(t) sinh(x — t) dt 
0 


satisfies the differential equation 
u'—u-h(x) x»0. 
(b) Rewrite u in the form 
u(x) = a(x)e * + b(x)e* 


and show that 
и' (х) = —a(x)e * + b(x)e*. 


(c) Show that if іт, оо a(x) = A (finite), then 
lim e?* [b(x) — B] = 0 
х->со 
for some constant В. HINT: Use Exercise 3.4.24. Show also that 
lim ех [u(x) — Ae * — Be*] = 0. 
х->со 
(d) Prove: ТЁйтх—› Р(х) = B (finite), then 
lim u(x)e * = lim м'(х)е * = B. 
х->со A-—OOD 
HINT: Use Exercise 3.4.23. 
28. Suppose that the differential equation 
и” + p(x)u = 0 (A) 


has a positive solution on [0, со), and therefore has two solutions yı and y» with the 
properties given in Exercise 3.4.26(b). 


(a) Prove: If Л is continuous on [0, со) and c; and сә are constants, then 


u(x) = с1у1(х) + e2y2(x) + f h(t) [yi(t)y2(%) — у1(х)у2@)] dt (B) 
satisfies the differential equation 
u” + p(x)u = h(x). 
For convenience in (b) and (c), rewrite (B) as 


u(x) = a(x)yı (x)  b(x)ya(x). 
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(b) Prove: If fj^ h(t) yz (t) dt converges, then [5° h(t)y1(t) dt converges, and 


lig LO А100) — Вуг(х) _ 
im ——— ——————————- 
хоо yi(x) 


0 


for some constants А апа B. HINT: Use Exercise 3.4.24 with f = hy» and 


g-— ys 
(c) Prove: If fj^ h(r)y1(t) dt converges, then 


wx) o, 


im = 
x—oo ya(x) 


for some constant B. HINT: Use Exercise 3.4.23 with f = hy, and g = 
y2/ yi- 
29. Suppose that f, fi, and g are continuous, f > 0, and ( f1/ f)! is absolutely inte- 
grable on [a, b). Show that /? Л (х) (х) dx converges if f? f (x)g(x) dx does. 


ЗО. Let g be locally integrable and f continuous, with f(x) > р > Ооп [a, b). Sup- 
pose that for some positive M and for every r in [a, b) there are points x; and x2 
such that (a) г < x1 < x2 < b; (b) g does not change sign in [х1, x2]; and 

x2 b ! | 
(c) f; |gG)| dx > М. Show that f, f(x)g(x) dx diverges. HINT: Use Exer- 
cise 3.4.7 and Theorem 3.3.7. 


3.5 A MORE ADVANCED LOOK AT THE EXISTENCE OF 
THE PROPER RIEMANN INTEGRAL 


In Section 3.2 we found necessary and sufficient conditions for existence of the proper 
Riemann integral, and in Section 3.3 we used them to study the properties of the integral. 
However, it is awkward to apply these conditions to a specific function and determine 
whether it is integrable, since they require computations of upper and lower sums and 
upper and lower integrals, which may be difficult. The main result of this section is an 
integrability criterion due to Lebesgue that does not require computation, but has to do 
with how badly discontinuous a function may be and still be integrable. 


We emphasize that we are again considering proper integrals of bounded functions on 
finite intervals. 


Definition 3.5.1 If f is bounded on [a, b], the oscillation of f on [a, b] is defined by 


уа, Б] = вир |/(х)— 70). 


а<х,х!< 


which сап also be written as 


Wyla.b]- sup f()- int, f(x) 


a<x<b 
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( Exercise 3.5.1). If a < x < b, the oscillation of f at x is defined by 


w f(x) = us W(x = А, x +h). 


The corresponding definitions for x — a and x — b are 


w f(a) = Ed Wr(a,a+h) and wy(b)-— а Wy (b — h, b). ш 


For a fixed x in (a, b), We (x — h, x + h) is a nonnegative and nondecreasing function 
of h for 0 < h < min(x — a, b — x); therefore, w (x) exists and is nonnegative, by 
Theorem 2.1.9. Similar arguments apply to w y (a) and w y (5). 


Theorem 3.5.2 Let f be defined on [a,b]. Then f is continuous at xo in [a,b] if 
and only if w ¢(xo) = 0. (Continuity at a or b means continuity from the right or left, 
respectively.) 


Proof Suppose that a < xo < b. First, suppose that w (xo) = 0 and e > 0. Then 
[хо = h, xo + h] < e 
for some h > 0, so 
|/(х)— f(x) «e if xo—h <x, x’ < xo+h. 
Letting x’ = xo, we conclude that 
|f(x) — f(xo)) «e if |x- xo] « ^. 


Therefore, f is continuous at xo. 


Conversely, if f is continuous at xo and є > 0, there is a ô > 0 such that 


IfG)- Хо) and 1706) – 7б) <5 


if xo ô < x, x’ < xo + 6. From the triangle inequality, 
Ро) — О) РО) — ео) + |F@’) – Хо)! « є, 


so 
Wr|xo = А, хо +h] <e if h«ó; 


therefore, w f (xo) = 0. Similar arguments apply if хо = a or xo = b. ш 


Lemma 3.5.3 f шу(х) < e fora < x < b, then there is a ё > 0 such that 
у [а1, bı] < є, provided that [a1, bı] C [а, b] and by — a4 < 6. 


Proof We use the Heine-Borel theorem (Theorem 1.3.7). If w f(x) « є, there is an 
hy > О such that 


|f (x) — f< e (3.5.1) 
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if 
x —2hy <x',x" <x+2h, and х, х" є [a,b]. (3.5.2) 
If I = (x — hy, x + hx), then the collection 
H = {I,|a<x <b} 


is an open covering of [a,b], so the Heine-Borel theorem implies that there are finitely 
many points x1, x2, ..., Xn in [а,Ь] such that Ix; , Do, .... Ix, cover [а,Ь]. Let 


h- min Лу, 
1<і<п 


and suppose that [a1, bı] С [a,b] and bı —a, < А. If x’ and x" аге in [а1, b1], then 
x' € I, for somer (1 € r < п), so 


|x’ — x,| < hy,. 
Therefore, 


Ix" — x,| < |x” — x'| + |x’ 2 xr| < b — a1 + hs, 
oe dii 


Thus, any two points x’ and x” in [a1, bi] satisfy (3.5.2) with x = x+, so they also satisfy 
(3.5.1). Therefore, € is an upper bound for the set 


ПРО) — fe [x x" e lar, bil}, 
which has the supremum Wy [a1 , b1]. Hence, Wr [а1, bi] < є. ш 
In the following, L(I) is the length of the interval Z. 


Lemma 3.5.4 Let f be bounded on |a, b] and define 


Ер = {x € [a,b] | wr) = p}. 
Then E, is closed, and f is integrable on [а,Ь] if and only if for every pair of positive 


numbers p and $, Ep can be covered by finitely many open intervals Ii, In,..., Ip such 
that 
p 
> ny) <6. (3.5.3) 
Ј=1 


Proof We first show that E, is closed. Suppose that xo is a limit point of Ep. If h > 0, 
there is an X from E, in (xo — h, xo +h). Since [x —hy,X + hy] C [xo — h, xo + A] for 
sufficiently small hı and W [x — hi, x + hy] = p, it follows that Wr [xo — h, xo + h] > p 
for all h > 0. This implies that xo € Ep, so E, is closed (Corollary 1.3.6). 


Now we will show that the stated condition in necessary for integrability. Suppose that 
the condition is not satisfied; that is, there is a р > 0 and a ó > 0 such that 


p 
X LES 
j=l 
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for every finite set (I1, /2,..., Ip} of open intervals covering Ej. If P = (xo %1,...,Xn} 
is a partition of [a, b], then 


S(P) - 5(Р) = (M; - mj); -xj- + X (Mj mj); = хуа), (3.544) 


Jed JEB 
where 
A= {j |x- x] NE, Z9) and B= {j |[xj-1,x;] N Ep = 0). 
Since Ujea (x j—1, xj) contains all points of E, except any of xo, x1, ..., Xn that may 


be in Ep, and each of these finitely many possible exceptions can be covered by an open 
interval of length as small as we please, our assumption on Ep implies that 


Уб, — Xj-1) > ô. 
jeA 
Moreover, if j € A, then 
Mj —m; = p, 
so (3.5.4) implies that 
S(P) - s(P) > р У (x; = xj-1) > pô. 
jeA 


Since this holds for every partition of [a, b], f is not integrable on [a, b], by Theorem 3.2.7. 
This proves that the stated condition is necessary for integrability. 


For sufficiency, let р and ô be positive numbers and let J1, I2, ..., Ip be open intervals 
that cover Е, and satisfy (3.5.3). Let 


T; BHAT, 


(Т j = closure of J.) After combining апу of Ti Т», ..., I p that overlap, we obtain a set 
of pairwise disjoint closed subintervals 


Су = læ; pj, 1sisq&p), 
of [a, b] such that 


a < оу < By «o» < B5: < ои < Bg-1 < Qq < Bg x b, (3.5.5) 


q 
У (Bi —aj) < 8 (3.5.6) 
i=1 

and 

wy(x)«p, Pj <xSajq1, 1<j<q-l. 


Also, w у(х) < p fora < x < a ifa < a, and for B; < x < bif By <b. 
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Let Po be the partition of [a, b] with the partition points indicated in (3.5.5), and refine 
Po by partitioning each subinterval [6 ;, o/;..1] (as well as [4,01] if a < a and [8,2] 
if Bg < b) into subintervals on which the oscillation of f is not greater than p. This is 
possible by Lemma 3.5.3. In this way, after renaming the entire collection of partition 
points, we obtain a partition P = (xo, х1,..., Xn} of [a, b] for which S(P) — s(P) can be 
written as in (3.5.4), with 


q 
У (ху -xj-0 = 3,86; - o) «8 
jeA i-l 


(see (3.5.6)) and 
Mj-mjsp, JEB. 


For this partition, 


XO Mj — mj)(xj -xj-0 < 2K у (xj - xj) <2K6, 
jeA ЎЄА 


where К is an upper bound for | f | on [а,Ь] and 


> M; - m); – xj-1) < pb — a). 


jeB 


We have now shown that if p and ó are arbitrary positive numbers, there is a partition P of 
[a, b] such that 


S(P) —s(P) « 2Kó + p(b — a). (3.5.7) 
If € > 0, let , c 
= Te and p= 2 
Then (3.5.7) yields 
S(P) —s(P) «e, 
and Theorem 3.2.7 implies that f is integrable on [a, b]. a 


We need the next definition to state Lebesgue’s integrability condition. 


Definition 3.5.5 A subset S of the real line is of Lebesgue measure zero if for every 


€ > 0 there is a finite or infinite sequence of open intervals Г, 75, ... such that 
sels (3.5.8) 
J 
and 
n 
YO LU) <e, п>1. (3.5.9) 
j=l 
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Note that any subset of a set of Lebesgue measure zero is also of Lebesgue measure zero. 
(Why?) 


Example 3.5.1 The empty set is of Lebesgue measure zero, since it is contained in 
any open interval. 


Example 3.5.2 Any finite set 5 = {x1,x2,...,Xn} is of Lebesgue measure zero, 
since we can choose open intervals 71, I2, ..., In such that x; € J; and L(/j) < e/n, 
lay <n. 


Example 3.5.3 An infinite set is denumerable if its members can be listed in a se- 
quence (that is, in a one-to-one correspondence with the positive integers); thus, 


SS AX, Nos eg Maedche (3.5.10) 


An infinite set that does not have this property is nondenumerable. Any denumerable set 
(3.5.10) is of Lebesgue measure zero, since if € > 0, it is possible to choose open intervals 
I, Iz, ..., so that x; € I; and L(1j) < 2e, j > 1. Then (3.5.9) holds because 


ase r aT "ES aa : .5. 
ш 


There are also nondenumerable sets of Lebesgue measure zero, but it is beyond the scope 
of this book to discuss examples. 


The next theorem is the main result of this section. 


Theorem 3.5.6 A bounded function f is integrable on a finite interval [а,Ь] if and 
only if the set S of discontinuities of f in [a, b] is of Lebesgue measure zero. 


Proof From Theorem 3.5.2, 
S = {x € [a,b] |w f(x) > 0}. 


Since ш y (x) > 0 if and only if wy (x) = 1/ for some positive integer i, we can write 


5= 5S. (3.5.12) 
where 
S; = {хє [a.b] | we (x) > 1/i}. 


Now suppose that f is integrable on [a, b] and € > 0. From Lemma 3.5.4, each S; can 
be covered by a finite number of open intervals /;1, /;2, ..., Iin of total length less than 
є/2'. We simply renumber these intervals consecutively; thus, 


Hh, 9-—Hiy.e. Hn La, - ++, Tangs ++ Tin, ++ Tings s+. 


Now (3.5.8) and (3.5.9) hold because of (3.5.11) and (3.5.12), and we have shown that the 
stated condition is necessary for integrability. 
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For sufficiency, suppose that the stated condition holds and є > 0. Then S can be 
covered by open intervals Г, /2,... that satisfy (3.5.9). If p > 0, then the set 


E, = {x € [a,b]|wy(x) = р) 


of Lemma 3.5.4 is contained in S (Theorem 3.5.2), and therefore E, is covered by Л, /5,.... 
Since E, is closed (Lemma 3.5.4) and bounded, the Heine-Borel theorem implies that E, 
is covered by a finite number of intervals from 71, /2,.... The sum of the lengths of the 
latter is less than e, so Lemma 3.5.4 implies that f is integrable on [a, 5]. ш 


3.5 Exercises 


1. In connection with Definition 3.5.1, show that 


sup |70) = f= sup f()- inf, fO) 


x,x’€[a,b] a<x<. 


2. Use Theorem 3.5.6 to show that if f is integrable on [a, b], then so is | f | and, if 
(x)= p>0(a <x <b), sois1/f. 

3. Prove: The union of two sets of Lebesgue measure zero is of Lebesgue measure 
zero. 

4. Use Theorem 3.5.6 and Exercise 3.5.3 to show that if f and g are integrable on 
[a, b], then so are f + g and fg. 

5. Suppose f is integrable on [a,b], а = infa<x<b f(x), and В = supa<x<p f(x). 
Let g be continuous on [a, В]. Show that the composition h = g o f is integrable 
on [a, b]. 

6. Let f be integrable on [a, b], let c = inf; <х<ь f(x) and В = sup, == f(x), and 
suppose that G is continuous on [a, В]. For each n > 1, let 


i — 1)(Ь — (Б — 
т G - D(5 —a) S J al 

n n 
Show that 


1 n 
im, = 5 160700) — GO @jn))| = 0. 
j=l 


T. Let h(x) = 0 for all x in [a, b] except for x in a set of Lebesgue measure zero. 


Show that if ГИ h(x) dx exists, it equals zero. HINT: Any subset of a set of measure 
zero is also of measure zero. 


8. Suppose that f and g are integrable on [a, b] and f(x) = g(x) except for x in a set 
of Lebesgue measure zero. Show that 


|. f(x)dx = S 


CHAPTER 4 


Infinite Sequences and Series 


IN THIS CHAPTER we consider infinite sequences and series of constants and functions 
of a real variable. 


SECTION 4.1 introduces infinite sequences of real numbers. The concept of a limit of a 
sequence is defined, as is the concept of divergence of a sequence to too. We discuss 
bounded sequences and monotonic sequences. The limit inferior and limit superior of a 
sequence are defined. We prove the Cauchy convergence criterion for sequences of real 
numbers. 


SECTION 4.2 defines a subsequence of an infinite sequence. We show that if a sequence 
converges to a limit or diverges to oo, then so do all subsequences of the sequence. Limit 
points and boundedness of a set of real numbers are discussed in terms of sequences of 
members of the set. Continuity and boundedness of a function are discussed in terms of the 
values of the function at sequences of points in its domain. 


SECTION 4.3 introduces concepts of convergence and divergence to Боо for infinite series 
of constants. We prove Cauchy's convergence criterion for a series of constants. In con- 
nection with series of positive terms, we consider the comparison test, the integral test, the 
ratio test, and Raabe's test. For general series, we consider absolute and conditional con- 
vergence, Dirichlet's test, rearrangement of terms, and multiplication of one infinite series 
by another. 


SECTION 4.4 deals with pointwise and uniform convergence of sequences and series of 
functions. Cauchy's uniform convergence criteria for sequences and series are proved, as 
is Dirichlet's test for uniform convergence of a series. We give sufficient conditions for 
the limit of a sequence of functions or the sum of an infinite series of functions to be 
continuous, integrable, or differentiable. 


SECTION 4.5 considers power series. It is shown that a power series that converges on 
an open interval defines an infinitely differentiable function on that interval. We define 
the Taylor series of an infinitely differentiable function, and give sufficient conditions for 
the Taylor series to converge to the function on some interval. Arithmetic operations with 
power series are discussed. 
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4.1 SEQUENCES OF REAL NUMBERS 


An infinite sequence (more briefly, a sequence) of real numbers is a real-valued function 
defined on a set of integers {n | п> k}. We call the values of the function the terms of the 
sequence. We denote a sequence by listing its terms in order; thus, 


{5л} = pepe (4.1.1) 


For example, 


ср. фе 1 
хз бый ы Жс ШЫ, 
slys 


{(-D"}o = {1,-1 


Ege qu 1 
п—2 А == ЫМА Зали . 


The real number 5, is the nth term of the sequence. Usually we are interested only in the 
terms of a sequence and the order in which they appear, but not in the particular value of k 
in (4.1.1). Therefore, we regard the sequences 


pog 1)? 
teal, "© 1А) 
n —2)4 nji 


We will usually write {sn} rather than {s,}?°. In the absence of any indication to the 
contrary, we take k = 0 unless 5, is given by a rule that is invalid for some nonnegative 
integer, in which case k is understood to be the smallest positive integer such that s, is 
defined for all п > К. For example, if 


and 


as identical. 


1 


“GoGo 


then k = 6. 


The interesting questions about a sequence (55) concern the behavior of s, for large n. 


Limit of a Sequence 


Definition 4.1.1 A sequence {sn} converges to a limit s if for every є > 0 there is an 
integer N such that 
ln —s|«e if n» М. (4.1.2) 


In this case we say that {sn} is convergent and write 
lim sy, = s. 
n—oo 


A sequence that does not converge diverges, or is divergent ш 
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As we saw in Section 2.1 when discussing limits of functions, Definition 4.1.1 is not 
changed by replacing (4.1.2) with 


sn —s| < Ke if n>N, 
where K is a positive constant. 
Example 4.1.1 If 5, = с forn > k, then|s,—c| = 0 forn > k, and іт, зоо Sn = c. 


Example 4.1.2 If 


2n+1 
у дааа а 
ü n+1 
then limy-+o9 Sn = 2, since 
2n+1 2n+4+2 1 
[Sn — 2| = |—— - ——_| = ——; 
n+1 n+1 n+1 
hence, if € > 0, then (4.1.2) holds with s = 2if N > 1/e. ш 


Definition 4.1.1 does not require that there be an integer N such that (4.1.2) holds for 
all e; rather, it requires that for each positive e there be an integer N that satisfies (4.1.2) 
for that particular e. Usually, № depends on є and must be increased if € is decreased. The 
constant sequences (Example 4.1.1) are essentially the only ones for which N does not 
depend on є (Exercise 4.1.5). 


We say that the terms of a sequence {5, }?° satisfy a given condition for all n if sn satisfies 
the condition for all n > k, or for large n if there is an integer № > k such that s, satisfies 
the condition whenever n > N. For example, the terms of (1/71? are positive for all n, 
while those of (1 — 7/n}f° are positive for large n (take N = 8). 


Uniqueness of the Limit 
Theorem 4.1.2 The limit of a convergent sequence is unique. 


Proof Suppose that 


lim 5, — s and lim s, = s'. 
noo noo 


We must show that s = s’. Let € > 0. From Definition 4.1.1, there are integers Љ№ and № 
such that 
lsn—s| «e if nz Ni 


(because іт, оо Sn = 5), and 


lsn—s'|<e if nz № 
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(because limy—+o9 Sn = 5^). These inequalities both hold ifn > N = max(N;, №), which 
implies that 


[s —s'| = |(s — sy) + (sw —5')| 
< |s—sy|+|sy —5"| < є + e = 2e. 


Since this inequality holds for every є > 0 and |s — s’| is independent of e, we conclude 
that |s — s’| = 0; that is, s = s’. a 
Sequences Diverging to +оо 


We say that 
lim 54, = oo 
п->со 


if for any real number a, Sn > a for large n. Similarly, 
lim Sn = —oo 
n—oo 
if for any real number а, Sn < a for large n. However, we do not regard (5,) as convergent 


unless Шт, оо Sn is finite, as required by Definition 4.1.1. To emphasize this distinction, 
we say that (54) diverges to oo (—оо) if lim, оо Sn = oo (—oo). 


Example 4.1.3 The sequence (n/2 + 1/n} diverges to oo, since, if a is any real num- 


ber, then 


n 1 . 
—-F—»a if n>2a. 
2 n 


The sequence {л — 1?) diverges to —oo, since, if a is any real number, then 
=n? +n = -n(n—1)<a if n>14+ vljal. 


Therefore, we write 


and 


lim (—n? + n) = —oo. 
п->со 


The sequence {(—1)"n7} diverges, but not to —оо or oc. 


Bounded Sequences 


Definition 4.1.3 A sequence {sn} is bounded above if there is a real number b such 
that 
Sn <b foralln, 


bounded below if there is a real number a such that 
Snza foralln, 
or bounded if there is a real number r such that 


[5 <r forall n. 
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Example 4.1.4 If s, = [1 + (—1)"]n, then {sn} is bounded below (s, > 0) but 
unbounded above, and (—5,) is bounded above (—5, < 0) but unbounded below. If s, = 
(= 1)", then {sn} is bounded. If s, = (—1)"n, then {s,} is not bounded above or below. 


Theorem 4.1.4 A convergent sequence is bounded. 
Proof Bytakinge = 1 in (4.1.2), we see that if іт, оо Sn = s, then there is an integer 


N such that 
ls. —s| «1 if n>N. 


Therefore, 
[51 = (sn —5) + s| < [sn —s| + |s] « 1 --|s] if n>N, 
and 
[Sn| S max{|so], [s1], Isid 1 + Isl} 
for all n, so {Sn} is bounded. a 


Monotonic Sequences 


Definition 4.1.5 A sequence {sn} is nondecreasing if Sn > 5р1 for all n, or nonin- 
creasing if Sn < Sy,—1 for all n. A monotonic sequence is a sequence that is either nonin- 
creasing or nondecreasing. If s, > 55. for all n, then {Sn} is increasing, whileifs, < Sy—1 
for all n, {Sn} is decreasing. 


Theorem 4.1.6 
(a) If {sn} is nondecreasing, then lims «oo Sn = sup{Sp}. 


(b) If {Sn} is nonincreasing, then limy-+oo Sn = inf {sy}. 
Proof (a). Let B = sup{s,}. If B < оо, Theorem 1.1.3 implies that if € > 0 then 
B-e«suy <Ê 
for some integer N. Since sy < s, < p if n > N, it follows that 
В-є<5 <В if n>N. 


This implies that |s, — 8| < eif n > N, so іт, оо Sn = p, by Definition 4.1.1. If B = oo 
and b is any real number, then sy > b for some integer N. Then s, > b forn > N, so 
limao Sn = oo. 

We leave the proof of (b) to you (Exercise 4.1.8) и 


Example 4.1.5 If so = 1 ands, = 1—e ?"-!, then0 < s, < 1 forall n, by induction. 
Since 
Sn+1 — Sn = —(e ?" е1) if nzl, 
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the mean value theorem (Theorem 2.3.11) implies that 
Sn+1 — Sn = е (Sn —Sn-1) if n> 1, (4.1.3) 


where f, is between 5„—1 and sn. Since 51 — so = —1/e < 0, it follows by induction from 
(4.1.3) that 5,41 — Sn < 0 for all n. Hence, {Sn} is bounded and decreasing, and therefore 
convergent. 


Sequences of Functional Values 


The next theorem enables us to apply the theory of limits developed in Section 2.1 to some 
sequences. We leave the proof to you (Exercise 4.1.13). 


Theorem 4.1.7 Letlimy—o. f(x) = L, where L is in the extended reals, and suppose 


that s, = f(n) for large n. Then 
lim 54, = L. 
n—oo 


Example 4.1.6 Let 


logn log x 
Sn = ш and f(x) = E 
n x 
Ву L Hospital’s rule, 
. . logx 1/x 
li = | == 
хэоо Xx х->со | 


Hence, іт, оо logn/n = 0. 


Example 4.1.7 Let s, = (1 + 1/n)” and 


x 
ey (142) = eran, 
x 
By L Hospital’s rule, 


1 log(1 + 1 
lim xlog ( + =) = lm eee) 
хоо х хоо 1/х 


Һепсе, 
1 x 1 n 
lim (1+2) =е! =е and lim (1+2) = e. 
хоо x n—oo n 


The last equation is sometimes used to define e. 
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Example 4.1.8 Suppose that s, = o" with p > 0, and let f(x) = p* = е1. Since 


0, iflogo<0 (0«pc«l) 
lim ех? = 41, iflogo=0 (р=1), 
хоо 


оо, iflogo>0 (р> 1), 


it follows that 


0, O<p<l, 
lim p" 2 41, p=1, 
n—oo 
oo, pl. 
Therefore, 
0, -l<r<l, 
lim r^ — 41, r=1, 
n—oo 
oo, r1, 


a result that we will use often. 


A Useful Limit Theorem 


The next theorem enables us to investigate convergence of sequences by examining simpler 
sequences. It is analogous to Theorem 2.1.4. 


Theorem 4.1.8 Let 
lim Sn =s and lim t, — f, (4.1.4) 
noo п->со 


where s and t are finite. Then 


lim (cs4) = cs (4.1.5) 
n—oo 
ifc is a constant; 
lim (Sn +h) 2 54 t, (4.1.6) 
поо 
lim (s, — tn) = 5 – 1, (4.1.7) 
n—oo 
lim (Sntn) = st, (4.1.8) 
n—oo 
and 
hm e (4.1.9) 
n> ty t 


if t4 is nonzero for all n and t # 0. 


Proof We prove (4.1.8) and (4.1.9) and leave the rest to you (Exercises 4.1.15 and 
4.1.17). For (4.1.8), we write 


5пЇһ — St = Sntn — Stn + Stn — St = (Sn — S)tg + S(tn — 1); 
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hence, 
[Sntn — St| < [sn — s| tn] + Is] = t]. (4.1.10) 
Since {t,} converges, it is bounded (Theorem 4.1.4). Therefore, there is a number R such 
that |t5| < R for all n, and (4.1.10) implies that 
ISntn — st| € R|sn — s| + |s| | — t]. (4.1.11) 
From (4.1.4), if € > 0 there are integers № and № such that 


lsn—s|«e if nz М, (4.1.12) 
and 
lta —t| «e if nz №. (4.1.13) 
If N = тах(№, №), then (4.1.12) and (4.1.13) both hold when n > М, and (4.1.11) 
implies that 
ISntn —st| < (К -|s)e if п> М. 
This proves (4.1.8). 


Now consider (4.1.9) in the special case where s, = 1 for all п and t Z 0; thus, we want 
to show that 


First, observe that since іт, oo tn = t # 0, there is an integer M such that |.| > |t|/2 
ifn > M. To see this, we apply Definition 4.1.1 with є = |t|/2; thus, there is an integer 
M such that |t, — t| < |t/2| ifn > M. Therefore, 
14| 


= lt + (ъ= 111 012 > if nM. 


If є > 0, choose No so that |t, — t| < eif n > No, and let N = max(No, M). Then 
1 1 


tn t 


|t — tnl 2€ 

|| || 
hence, limy—oo 1/t, = 1/t. Now we obtain (4.1.9) in the general case from (4.1.8) with 
{tn} replaced by {1/їһ}. ш 


if n>N; 


Example 4.1.9 To determine the limit of the sequence defined by 
1. nx J 2(1 + 3/n) 
Sn = — sin — + —————, 

" mn 4 1+1/n 
we apply the applicable parts of Theorem 4.1.8 as follows: 
" 2| tim 1 +3 lim а/л)] 
P ; : л noo noo 
lim sn = lim — sin — + ———— ————————- 
n—oo n> П 4 lim 1 + lim (1/n) 

n—oo n—oo 
2(1+3.0) _ 


=04+ 7 =2. 
1+0 
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Example 4.1.10 Sometimes preliminary manipulations are necessary before applying 
Theorem 4.1.8. For example, 


.. (n/2) + logn . 1/2+ (logn)/n 
lim ——— ———— = lim ———————— 
noo 3n+4./n no 3 + 4n71/2 
lim 1/2+ lim (logn)/n 
n—oo n—oo 
lim 3 + 4 lim n? 
n—oo поо 
| 1/240 
| 340 


(see Example 4.1.6) 


1 
A 
Example 4.1.11 Suppose that—1 <r < 1 and 
so=l, sp=ltr, s=1+r+r?,..., =l+r+ +r". 
Since 
Sn = rSn = (1 +r +r”) rtr?" =1—т"+!, 


it follows that 


1— pnt 
Sn = (4.1.14) 
l-r 
From Example 4.1.8, lim, oo r”*! = 0, so (4.1.14) and Theorem 4.1.8 yield 
1 
lim (1 +r +- +r”) = — if -l<r<l. a 
n—oo l-r 


Equations (4.1.5)-(4.1.8) are valid even if s and ¢ are arbitrary extended reals, provided 
that their right sides are defined in the extended reals (Exercises 4.1.16, 4.1.18, and 4.1.21); 
(4.1.9) is valid if s/t is defined in the extended reals and t # 0 (Exercise 4.1.22). 


Example 4.1.12 If—1 <r < 1, then 


r 

lim — = — — = (0), 

n> n! lim n! oo 
noo 


n lim r 
r eso оо 
lim — = — =—, 
поо n! lim n! oo 
п->со 


an indeterminate form. If < —1, then lim —oo r” does not exist in the extended reals, so 
(4.1.9) is not applicable. Theorem 4.1.7 does not help either, since there is no elementary 
function f such that f(n) = r"/n!. However, the following argument shows that 
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n 


dme боб: (4.1.15) 


There is an integer M such that 


Ir} 1 
— <- if л> М 
n 2 
Let K = r"/M!. Then 
Iri" | dr o dn poc 
< К єс —<Кур— ‚а> М 
п! М+ІіМ +2 п 2 


Given є > 0, choose N > M so that K/2N-M < e, Then |r|"/n! < eif n > N, which 
verifies (4.1.15). 


Limits Superior and Inferior 


Requiring a sequence to converge may be unnecessarily restrictive in some situations. Of- 
ten, useful results can be obtained from assumptions on the limit superior and limit inferior 
of a sequence, which we consider next. 


Theorem 4.1.9 


(a) If {sn} is bounded above and does not diverge to —oo, then there is a unique real 
number s such that, if € > 0, 


Sn <S+e forlargen (4.1.16) 


and 
Sn >S—€ for infinitely many n. (4.1.17) 


(b) Jf {sn} is bounded below and does not diverge to oo, then there is a unique real 
number s such that, if € > 0, 


Sn > $—є forlargen (4.1.18) 


and 
Sn <5 +e for infinitely many n. (4.1.19) 


Proof We will prove (a) and leave the proof of (b) to you (Exercise 4.1.23). Since 
{Sn} is bounded above, there is а number p such that s, < В for all n. Since {sn} does not 


diverge to —оо, there is a number o such that Sn > o for infinitely many n. If we define 


My = SUP{Sk, =, -<3 Sk4rs sede 
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thena < My < B,so {Mx} is bounded. Since ( Мк } is nonincreasing (why?), it converges, 
by Theorem 4.1.6. Let 
у= lim Mg. (4.1.20) 
k—oo 


If € > 0, then Мк < 5 + є for large k, and since s, < My for n > К, 5 satisfies (4.1.16). 


If (4.1.17) were false for some positive e, there would be an integer K such that 
Sn <5—-є if п> К. 


However, this implies that 
Myxs—e if К> К, 


which contradicts (4.1.20). Therefore, s has the stated properties. 


Now we must show that 5 is the only real number with the stated properties. If t < s, the 
inequality 


jj a: _ Tet 
Sn < —— = $ — 
ý 2 2 


cannot hold for all large n, because this would contradict (4.1.17) with € = (5 — t)/2. If 
5 < t, the inequality 


t-5_ 1-5 
Sn>t— m 5 + ? 
cannot hold for infinitely many n, because this would contradict (4.1.16) with € = (t—s)/2. 
Therefore, 5 is the only real number with the stated properties. E 


Definition 4.1.10 The numbers 5 and s defined in Theorem 4.1.9 are called the limit 
superior and limit inferior, respectively, of {sn}, and denoted by 


у = lim s, and s= lim Sy. 
n—oo n>% 
We also define 
lim s, = oo if{sn} is not bounded above, 
n—oo 
lim Sn =—oo if lim 54, = —oo, 
noo n—oo 
lim s, = —oo if {sn} is not bounded below, 
поо 
апа : "mE 
lim Sn = oo if lim sy =o. 
n>% n—oo 


Theorem 4.1.11 Every sequence {sy} of real numbers has a unique limit superior, S, 
and a unique limit inferior, s, in the extended reals, and 


5 <Ў. (4.1.21) 
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Proof The existence and uniqueness of 5 and s follow from Theorem 4.1.9 and Defini- 
tion 4.1.10. If 5 and s are both finite, then (4.1.16) and (4.1.18) imply that 


s-€<S+eE 


for every є > 0, which implies (4.1.21). If s = —oo or s = oo, then (4.1.21) is obvious. If 
5 = oo or $ = —oco, then (4.1.21) follows immediately from Definition 4.1.10. ш 


Example 4.1.13 


оо, |r| > 1, 
lm "= 41, |r| =1, 
ee 0, |r| <1; 
and 
oo, r1, 
1, к= 
іп" = ү 0, |r| <1, 
NEROS -l, r=-l 
—oo, r«-1 
Also, 
lim n? = lim n? = oo, 
n-*oo n—oo 
— ДИ. | TAN. 
lim(-1"^[1——-]-21, lm(-1"[n—-—-|--l, 
noo n n—oo n 
and 


lim [1 + (-1)"]n? = oo, lim [1 + (-1)"]n? = 0. 
n—oo n—oo 


Theorem 4.1.12 If{sn} is a sequence of real numbers, then 


lim Sn = 5 (4.1.22) 
n—oo 
if and only if 
lim 5, = lim s, — s. (4.1.23) 
Iro поо 


Proof Ifs = +оо, the equivalence of (4.1.22) and (4.1.23) follows immediately from 
their definitions. If liM >оо Sn = s (finite), then Definition 4.1.1 implies that (4.1.16)— 
(4.1.19) hold with 5 and s replaced by s. Hence, (4.1.23) follows from the uniqueness of 
5 and s. For the converse, suppose that 5 = s and let s denote their common value. Then 
(4.1.16) and (4.1.18) imply that 


S-€<S,<S+E 


for large n, and (4.1.22) follows from Definition 4.1.1 and the uniqueness of lim; oo Sn 
(Theorem 4.1.2). E 
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Cauchy’s Convergence Criterion 


To determine from Definition 4.1.1 whether a sequence has a limit, it is necessary to guess 
what the limit is. (This is particularly difficult if the sequence diverges!) To use Theo- 
rem 4.1.12 for this purpose requires finding 5 and s. The following convergence criterion 
has neither of these defects. 


Theorem 4.1.13 (Cauchy’s Convergence Criterion) A sequence {Sn} of 
real numbers converges if and only if, for every € > 0, there is an integer N such that 


lsn—5m| «€  т,п> М. (4.1.24) 


Proof Suppose that limy—oo Sn = s and є > 0. By Definition 4.1.1, there is an integer 
N such that Р 
|, —5|< 5 if л> М. 


Therefore, 
[Sn = 5m| = |(Sn — S) + (S — Sm)| € |sn -s| + |8—Sm| <€ if л, т> М. 


Therefore, the stated condition is necessary for convergence of (54). To see that it is suffi- 
cient, we first observe that it implies that (55) is bounded (Exercise 4.1.27), so 5 and s аге 
finite (Theorem 4.1.9). Now suppose that € > 0 and N satisfies (4.1.24). From (4.1.16) 
and (4.1.17), 

|5 —3| < €, (4.1.25) 


for some integer n > N and, from (4.1.18) and (4.1.19), 
Im —s] < € (4.1.26) 
for some integer m > N. Since 
[s — s| = |(S — 5а) + Gn — Sm) + (Sm — 5)| 
< [s — sn| + [Sn — Sm| + |Sm — 5], 


(4.1.24)-(4.1.26) imply that 
[s 5| < 3e. 


Since є is an arbitrary positive number, this implies that 5 = s, so (54) converges, by 
Theorem 4.1.12. ш 


Example 4.1.14 Suppose that 
[f'(x)|<r<1, —-oo«x«oo. (4.1.27) 


Show that the equation 
x= f(x) (4.1.28) 


has a unique solution. 
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Solution To see that (4.1.28) cannot have more than one solution, suppose that x — 
f(x) and x’ = f(x’). From (4.1.27) and the mean value theorem (Theorem 2.3.11), 


x —x' = f'(c)x —-x) 
for some c between x and x'. This and (4.1.27) imply that 
Ix - x'| x rix — x']. 


Sincer « 1, x = x’. 
We will now show that (4.1.28) has a solution. With xo arbitrary, define 


Xn = }(хһ-1), n>. (4.1.29) 
We will show that {x,} converges. From (4.1.29) and the mean value theorem, 
Xn41 — Xn = f (Xn) — f xn-1) = f’ (Cn) On — Xn-1), 
where c, is between x, and xn. This and (4.1.27) imply that 
|Xn41 = Xa] € r|Xn — xai]. if n>. (4.1.30) 


The inequality 
|ы = ха € r"|xi — xo| if n> 0, (4.1.31) 
follows by induction from (4.1.30). Now, if n > m, 
[Xn — Xml = |Gxn — Xn-1) + (Хл—1 — Xn-2) +++ (Xm+1 Хп) 


< [Xn = Xn 1| + [xn 1] — Хп 2| t + |Xm+1 = Xml, 


and (4.1.31) yields 
[zs exul ТЕТЕ най (4.1.32) 
In Example 4.1.11 we saw that the sequence {sx} defined by 
ве = l+tr+---+r* 


converges to 1/(1 — r) if |r| < 1; moreover, since we have assumed here that 0 < r < 1, 
{sx} is nondecreasing, and therefore 5р < 1/(1 — г) forall k. Therefore, (4.1.32) yields 


Хр = х 
"р if n>m. 
Now it follows that 
х= х 
eee f ol N if n,m>N, 
—r 


and, since limy+or% = 0, {xn} converges, by Theorem 4.1.13. If X = limp—+oo Xn, then 
(4.1.29) and the continuity of f imply that X = f(x). 
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10. 


11. 


12. 


13. 
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4.1 Exercises 


Prove: If s, > 0 for n > К and іт, _»оо Sn = s, then s > 0. 

(a) Show that limyoo Sn = 5 (finite) if and only if lim, оо |5n — s| = 0. 

(b) Suppose that |s, — s| < tn for large n and limp—>oo fn = 0. Show that 
limy—+oo Sn = 5. 


Find limy— oo Sn. Justify your answers from Definition 4.1.1. 


1 a+n 1. ил 
(3) eS 2 ттт (c) sn = — sin -7 
Find limy—oo Sn. Justify your answers from Definition 4.1.1. 
n n?+2n+2 
üja —— (bjp = 
(ali 2n t Jn 1 (b) sn n? +n 
(c) s, = —— (d) s, = Vn? -n—n 


Jn 


State necessary and sufficient conditions on a convergent sequence {Sn} such that 
the integer N in Definition 4.1.1 does not depend upon e. 


Prove: If lim, 455 Sn = s then іт, оо |Sn| = |s|. 


Suppose that іт, оо Sn = 5 (finite) and, for each є > 0, |5, — tn| < є for large n. 
Show that limy,-+95 f, = 5. 


Complete the proof of Theorem 4.1.6. 


Use Theorem 4.1.6 to show that {s,} converges. 
! 


a+n n: 
(aeo en (B > 0) (b) s, = — 
r” (2n)! 
vr mdr (9) sa = yr 


Let y = Тап !x be the solution of х = tan y such that —/2 < y < 1/2. Prove: 
If xo > 0 and x441 = Tan! x, (n > 0), then {xn} converges. 


Suppose that so and А are positive numbers. Let 


(+5) 
Sn+1 = {5 Б |, n=O. 
2 Sn 


(a) Show that sn+ı > JA ifn > 0. 

(b) Show that 5,41 < ss if > 1. 

(c) Show that s = limy-oo Sn exists. 

(d) Finds. 

Prove: If {5 } is unbounded and monotonic, then either lim, оо Sy = oo or liMyp—+oo Sn = 
—oo. 

Prove Theorem 4.1.7. 


14. 


15. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 
24. 
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Use Theorem 4.1.7 to find limy—+o9 55. 
a+n 
Btn 
(c) sn = nsin- (d) s, =logn—n 


(а) s, = (B > 0) (b) s, = cos 


(e) sn = log(n + 1) — log(n — 1) 


Suppose that limy-+oo Sn = 5 (finite). Show that if c isa constant, then liMmp—>oo (с) = 


CS. 


Suppose that іт, оо Sn = 5 where 5 = +оо. Show that if c is a nonzero constant, 
then limy—+o0(C5,) = cs. 


Prove: If lim, o5 Sn = s and Шт, 555 ty = t, where s and t are finite, then 


lim (Sn +t) =s+t and lim (Sn — tn) = s — t. 
n—oo n—oo 


Prove: If Шт, оо Sn = 5 and Шт, оо tn = t, where s and t are in the extended 
reals, then 

lim (Sn +t) =s+t 

n—oo 


if s + t is defined. 


Suppose that іт, _»оо t, = t, where 0 < |t| < оо, and let 0 < p < 1. Show that 
there is an integer N such that t, > pt forn > N ift > 0, ort, < pt forn > N if 
t < 0. In either case, |ї„| > plt| ifn > N. 

Prove: If 


Sn — 


: $ : 
lim —0, then lim 54 = s. 
n> $4 +S noo 
HINT: Define tn = (Sn — s)/(sn + 5) and solve for sp. 
Prove: if limy—+oo Sn = 5 and Шт, оо t, = t, where s and ¢ are in the extended 
reals, then 
lim Sntn = st 
n—oo 
provided that 57 is defined in the extended reals. 


Prove: If lim; +99 Sn = s and limy-+99 tn = t, then 


lim — = - (A) 
if s/t is defined in the extended reals and t # 0. Give an example where s/t is 
defined in the extended plane, but (A) does not hold. 

Prove Theorem 4.1.9(b). 
Find 5 and s. 


(a) sn = [C D" + 1]n? (b) s, = (1— r^) sin 
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2n 


[ 


(c) ss ea (r 4-1) (d) s, =n?—n 
(e) sn = (—1)"t where limyp+oo tn = t 
25. Finds and s. 
(a) s, = C1» (b) s, = (-1)" (2 + =) 
(c) sa = 07080 (d) on = sin Z 


26. Suppose that limy—oo |Sn| = y (finite). Show that {sn } diverges unless y = 0 or the 
terms in (54) have the same sign for large n. HINT: Use Exercise 4.1.19. 


27. Prove: The sequence {s,} is bounded if, for some positive e, there is an integer № 
such that |s, — Sm| < € whenever n, m > М. 


In Exercises 4.1.28—4.1.31, assume that s, s (or s), t, and t are in the extended reals, and 
show that the given inequalities or equations hold whenever their right sides are defined 
(not indeterminate). 


28. (a) „бт (754) =о—у (b) lim (—s,) = —s 
29. (a) lim (sy + mm) <3 +7 (b) lim (s, +) 2 s-Ft 


30. (a)Ifs, > 0, tn > 0, then (i) lim spt, < st and (ii) lim satn > st. 
noo 


n—oo 


(b) If s, < 0, tn > 0, then (i) im Snin < 51 and (ii) lim spt, > sf. 


n—oo 
31. (a) If lim s, 2 > Oand t, > 0, then (i) lim spt, = sf and (ii) lim spt, = st. 
n—oo n—oo ораган 
(b) If lim s, = s <Oandt, > 0, ћеп (i) lim Sntn = stand (ii) lim spt, = sr. 
n—oo noo n—oo 
32. Suppose that {s,} converges and has only finitely many distinct terms. Show that sn 
is constant for large n. 


33. Let so and s; be arbitrary, and 


Sn + Sn-1 
$441 = ————, nel. 
2 
Use Cauchy’s convergence criterion to show that {s,} converges. 
S1 HS2 tc Sn 
n $ 


ЗА. Lett, = 


n> 1. 


(a) Prove: If limp-+oo Sn = s then іт, о, = 5. 
(b) Give an example to show that {tn} may converge even though {sn} does not. 
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35. (a) Show that 


jm (0-207) - 2) = exe 


HINT: Look at the logarithm of the absolute value of the product. 
(b) Conclude from (a) that 


lim (") = if q»-1, 
поо \ и 


where \‹) is the generalized binomial coefficient of Example 2.5.3. 
n 


4.2 EARLIER TOPICS REVISITED WITH SEQUENCES 


In Chapter 2.3 we used e—ó definitions and arguments to develop the theory of limits, 
continuity, and differentiability; for example, f is continuous at xo if for each € > 0 there 
isa ô > 0 such that | f(x) — f(xo)| < € when |x — xo| < ô. The same theory can be 
developed by methods based on sequences. Although we will not carry this out in detail, 
we will develop it enough to give some examples. First, we need another definition about 
sequences. 


Definition 4.2.1 A sequence {t,} is a subsequence of a sequence {sn} if 
tk = Sn k > 0, 


where {лк} is an increasing infinite sequence of integers in the domain of {s,}. We denote 
the subsequence {tk} by (55, }. ш 


Note that {sn} is a subsequence of itself, as can be seen by taking nz = К. All other 


subsequences of {s,,} are obtained by deleting terms from {sn } and leaving those remaining 
in their original relative order. 


(s) = H = C 


then letting ng = 2k yields the subsequence 


а л 
S2k} = 2k = PPOO] E 


and letting ny = 2k + 1 yields the subsequence 


opa FL e fil 1 В 
зев ааг" 


Example 4.2.1 If 
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Since a subsequence (55, } is again a sequence (with respect to k), we may ask whether 
{Sny } converges. 


Example 4.2.2 The sequence {sn} defined by 


in = (—1)" (: + 9 
n 


does not converge, but {sn } has subsequences that do. For example, 
{Sox} = ees and lim sp, = 1 
= n im = 5 


while А 
-— rer 
{Sox4i} | kad 


It сап be shown (Exercise 4.2.1) that a subsequence (55, } of {Sn} converges to 1 if and 
only if n; is even for k sufficiently large, or to —1 if and only if л is odd for k sufficiently 
large. Otherwise, {s,,} diverges. E 


and lim S2k+1 = —1. 
k—oo 


The sequence in this example has subsequences that converge to different limits. The 
next theorem shows that if a sequence converges to a finite limit or diverges to too, then 
all its subsequences do also. 


Theorem 4.2.2 If 


lim $, =s (—œ <s < ою), (4.2.1) 
n—oo 
then 
lim sp, = 5 (4.2.2) 
k—oo 


for every subsequence (5g, } of {Sn}. 


Proof We consider the case where s is finite and leave the rest to you (Exercise 4.2.4). 
If (4.2.1) holds and e > 0, there is an integer N such that 


lsn—s|«e if n>N. 


Since {nx} is an increasing sequence, there is an integer K such that ny > N if k > K. 
Therefore, 
ls, = ШЦ «e if К> К, 


which implies (4.2.2). E 
Theorem 4.2.3 If{sn} is monotonic and has a subsequence (sg, } such that 
lim sn, =з (—00 <s < оо), 
k—oo 


then 
lim sy, = s. 
n—oo 


Section 4.2 Earlier Topics Revisited with Sequences 197 


Proof We consider the case where {sn} is nondecreasing and leave the rest to you (Ex- 
егсіѕе 4.2.6). Since (55, } is also nondecreasing in this case, it suffices to show that 


sup{sn,} = supisn] (4.2.3) 


and then apply Theorem 4.1.6(a). Since the set of terms of (s, } is contained in the set of 
terms of {Sn}, 


sup{sn} > supisn, }. (4.2.4) 
Since {s,} is nondecreasing, there is for every n an integer ng such that Sn < Snp. This 
implies that 

sup{sn} < sup{Sn, }- 
This and (4.2.4) imply (4.2.3). a 


Limit Points in Terms of Sequences 


In Section 1.3 we defined limit point in terms of neighborhoods: x is a limit point of a set 
S if every neighborhood of x contains points of S distinct from x. The next theorem shows 
that an equivalent definition can be stated in terms of sequences. 


Theorem 4.2.4 A point X is a limit point of a set S if and only if there is a sequence 
{xn} of points in S such that x, #X forn > 1, and 


lim x, =X. 
n—oo 


Proof For sufficiency, suppose that the stated condition holds. Then, for each є > 0, 
there is an integer N such thatO < |x, —x| < eifn > N. Therefore, every e-neighborhood 
of x contains infinitely many points of S. This means that x is a limit point of S. 


For necessity, let x be a limit point of S. Then, for every integer n > 1, the interval 
(x — I/n,x + 1/n) contains a point x, (5 x) in S. Since |x» — x| < 1/n if m > n, 
limy—+oo Xn = X. ш 

We will use the next theorem to show that continuity сап be defined in terms of se- 
quences. 

Theorem 4.2.5 
(a) If {xn} is bounded, then {xn} has a convergent subsequence. 


(b) If {xn} is unbounded above, then {xn} has a subsequence (xs, } such that 


lim Xn, = oo. 
k—oo 


(c) If {xn} is unbounded below, then {xn} has a subsequence (xs, ) such that 


lim Xn, = —oo. 
k—oo 
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Proof We prove (a) and leave (b) and (c) to you (Exercise 4.2.7). Let S be the 
set of distinct numbers that occur as terms of {x,}. (For example, if {xn} = {(—1)”}, 
S = {1,—1}; if {xa} = (1,5,1,9,...,1,1/n,...}, S = (,1,...,1/n,...)) If S 
contains only finitely many points, then some x in 5 occurs infinitely often in (x; that is, 
{Xn} has a subsequence (x5, } such that xn, = x for all k. Then limg_,o9 Хп, = x, and we 


are finished in this case. 


If S is infinite, then, since S is bounded (by assumption), the Bolzano—Weierstrass the- 
orem (Theorem 1.3.8) implies that S has a limit point x. From Theorem 4.2.4, there is a 
sequence of points {уу} in S, distinct from x, such that 


lim yj =X. (4.2.5) 


Although each y; occurs as a term of {xn}, {уу} is not necessarily a subsequence of {xy}, 
because if we write 

Yj = Хп; 
there is по reason to expect that (7;) is an increasing sequence as required in Defini- 
tion 4.2.1. However, it is always possible to pick a subsequence {n ;,} of (n;j that is 
increasing, and then the sequence {уу} = {Snj, } is a subsequence of both {y ; } and {xn}. 
Because of (4.2.5) and Theorem 4.2.2 this subsequence converges to X. E 


Continuity in Terms of Sequences 
We now show that continuity can be defined and studied in terms of sequences. 


Theorem 4.2.6 Let f be defined on a closed interval [a, b] containing x. Then f is 
continuous at X (from the right if x = a, from the left if x = b) if and only if 


lim (хь) = f(x) (4.2.6) 
п->со 
whenever {xn} is a sequence of points їп [a, b] such that 


lim x, — X. (4.2.7) 
noo 


Proof Assume that a « x « b; only minor changes in the proof are needed if x = a or 
х = b. First, suppose that f is continuous at X and {xn} is a sequence of points in [а,Ь] 
satisfying (4.2.7). If € > 0, there is а ô > 0 such that 


|/(х)— f@|<e if |x^-x| « 6. (4.2.8) 


From (4.2.7), there is an integer N such that |x, — X| < ó if n > N. This and (4.2.8) 
imply that | f (xn) — f(x)| < e ifn > М. This implies (4.2.6), which shows that the stated 
condition is necessary. 

For sufficiency, suppose that f is discontinuous at x. Then there is an є > 0 such that, 
for each positive integer n, there is a point x, that satisfies the inequality 


= 1 
|X, = X| < — 
n 
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while 

|f (xn) — f(x)] > є. 
The sequence {x,} therefore satisfies (4.2.7), but not (4.2.6). Hence, the stated condition 
cannot hold if f is discontinuous at x. This proves sufficiency. E 


Armed with the theorems we have proved so far in this section, we could develop the 
theory of continuous functions by means of definitions and proofs based on sequences and 
subsequences. We give one example, a new proof of Theorem 2.2.8, and leave others for 
exercises. 


Theorem 4.2.7 If f is continuous on a closed interval [a, b], then f is bounded on 
[a, b]. 


Proof The proof is by contradiction. If f is not bounded on [a, b], there is for each 
positive integer n a point x, in [а,Ь] such that | f (xn)| > n. This implies that 


lim |f n) = oo. (4.2.9) 


Since {хп} is bounded, {xn} has a convergent subsequence {хл } (Theorem 4.2.5(a)). If 
x= lim хп, 
k—oo 
then x is a limit point of [a, b], so x € [а,Ь]. If f is continuous on [a, b], then 
lim f&n) = f(x) 

k—oo 
by Theorem 4.2.6, so 

lim | f(%n,)| = 17601 

k—oo 


(Exercise 4.1.6), which contradicts (4.2.9). Therefore, f cannot be both continuous and 
unbounded on [a, 5] a 


4.2 Exercises 


1. Lets, = (—1)"(1 + 1/n). Show that limp oo Sny = 1 if and only if ng is even for 
large k, liMķ—>oo Sn, = —1 if and only if nx is odd for large k, and {sn, } diverges 
otherwise. 

2. Find all numbers L in the extended reals that are limits of some subsequence of {sn} 
and, for each such L, choose a subsequence {s,, } such that limg_,o9 Sn, = L. 


(а) s, = (-1)"n (b) s, = (1 + =) cos E 
(с) sn = (1-5) sin (d) in = 1 
(e) sn = [C1)" + 1]n? (£) sn = a (sin + cos 5) 
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10. 


11. 
12. 


13. 
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Construct a sequence {sn} with the following property, or show that none exists: for 
each positive integer т, {Sn} has a subsequence converging to m. 

Complete the proof of Theorem 4.2.2. 

Prove: If іт, оо Sn = s and {sn} has a subsequence { 5», } such that (7D Sn, > 0), 
ер 5 = 0. 

Complete the proof of Theorem 4.2.3. 

Prove Theorem 4.2.5(b) and (c). 


Suppose that {sn} is bounded and all convergent subsequences of {sn} converge to 
the same limit. Show that {s,} is convergent. Give an example showing that the 
conclusion need not hold if {sn} is unbounded. 


(a) Let f be defined on a deleted neighborhood N of x. Show that 
lim f(x) 2L 
xXx 


if and only if lim, »оо f (xn) = L whenever {xn} is a sequence of points in N 
such that lim, оо x, = x. HINT: See the proof of Theorem 4.2.6. 
(b) State a result like (a) for one-sided limits. 


Give a proof based on sequences for Theorem 2.2.9. HINT: Use Theorems 4.1.6, 
4.2.2, 4.2.5, and 4.2.6. 

Give a proof based on sequences for Theorem 2.2.12. 

Suppose that f is defined on a deleted neighborhood N of x and {f(xn)} ap- 
proaches a limit whenever {x,} is a sequence of points in № and іт, оо Xn = 
x. Show that if {xn} and {yn} are two such sequences, then limy+oo f(x4) = 
limp co f (Yn). Infer from this and Exercise 4.2.9 that lim, f(x) exists. 


Prove: If f is defined on a neighborhood N of x, then f is differentiable at x if and 


only if 
km Гол) 700) 
m —————— 
n—oo Xn =X 
exists whenever (x4) is a sequence of pointsin N such that x, Z x and Шш» Xn = 


x. HINT: Use Exercise 4.2.12. 


4.3 INFINITE SERIES OF CONSTANTS 


The theory of sequences developed in the last two sections can be combined with the fa- 
miliar notion of a finite sum to produce the theory of infinite series. We begin the study of 
infinite series in this section. 


Definition 4.3.1 If {an}? is an infinite sequence of real numbers, the symbol 


оо 
2 ап 
n=k 
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is an infinite series, and dy is the nth term of the series. We say that Xx ап converges to 


the sum A, and write 
oo 
X =A, 
n=k 


if the sequence { 4,37? defined by 
An = dk + ар + dg, n>k, 
converges to A. The finite sum A, is ће nth partial sum of 3 рск dn. If {An jg diverges, 


we say that uk an diverges; in particular, if limp An = oo or —oo, we say that 
X> g ап diverges to oo or —oo, and write 


oo oo 
у dn = оо Or у dn = —OQ. 
n=k n=k 


A divergent infinite series that does not diverge to +оо is said to oscillate, or be oscillatory. 


a 
We will usually refer to infinite series more briefly as series. 
Example 4.3.1 Consider the series 
oo 
у, r”, -l<r<l. 
п=0 
Here a, = r" (n > 0) and 
1— pni 
An —l04raAr?4eLpD- i А (4.3.1) 
= г 
which converges to 1/(1 — r) as n — oo (Example 4.1.11); thus, we write 
оо " 1 
у, [a= 1 , -l«r«l. 
n=0 = 
If |r| > 1, then (4.3.1) is still valid, but °°.) r” diverges; if r > 1, then 
oo 
SP =o, (4.3.2) 


while if < —1, У у” oscillates, since its partial sums alternate in sign and their 
magnitudes become arbitrarily large for large n. If r = —1, then A2m+1 = 0and 455, = 1 
for m > 0, while ifr = 1, A, = n + 1; in both cases the series diverges, and (4.3.2) holds 
ifr = 1. ш 
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The series У 9 r” is called the geometric series with ratio т. It occurs in many appli- 
cations. 


An infinite series can be viewed as a generalization of a finite sum 


N 
A=} as mak apa +: +ам 
n=k 
by thinking of the finite sequence (ag, dx41,...,aNn} as being extended to an infinite se- 
quence {аһ}? with a, = 0 forn > №. Then the partial sums of уо da ate 


An = ак + акі +: + dg, kzn«N, 


and 
An =A, n>N; 


that is, the terms of {Аһ} equal the finite sum A for n > k. Therefore, іт, оо An 
= A. 

The next two theorems can be proved by applying Theorems 4.1.2 and 4.1.8 to the partial 
sums of the series in question (Exercises 4.3.1 and 4.3.2). 


Theorem 4.3.2 The sum of a convergent series is unique. 


Theorem 4.3.3 Let 


oo oo 
Sian =A and b. = B, 
=k =k 

where A and B are finite. Then 


> (can) =cA 
n=k 


if c is a constant, 
oo 


Уа +) = AFB, 
n=k 
and 


X (an - bn) = A-B. 
=k 


These relations also hold if one or both of A and B is infinite, provided that the right sides 
are not indeterminate. 


Dropping finitely many terms from a series does not alter convergence or divergence, 
although it does change the sum of a convergent series if the terms dropped have a nonzero 
sum. For example, suppose that we drop the first k terms of a series Y 7. Gn, and consider 
the new series > усу dn. Denote the partial sums of the two series by 

Án — do Fd da, п2 0, 
and 
А = ак Бакі dod ds, п> К. 
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Since 
An = (ag +41 +: Фар) + AL, п> К, 


it follows that A = lim; оо А» exists (in the extended reals) if and only if A’ = lim, soo Aj, 


does, and in this case 
A = (ao +41 ++ aki) + A’. 


An important principle follows from this. 


Lemma 4.3.4 Suppose that for n sufficiently large (that is, for n > some integer N) 
the terms of Y», ап satisfy some condition that implies convergence of an infinite series. 
Then Y 5. ап converges. Similarly, suppose that for n sufficiently large the terms У), аһ 
satisfy some condition that implies divergence of an infinite series. Then У, an diverges. 


Example 4.3.2 Consider the alternating series test, which we will establish later as a 
special case of a more general test: 


The series X аһ converges if (-1)" ay > 0, |jan+ı| < |а|, and lim, зо ап = 0. 


The terms of 
oo 


16 4- (-2)" 
pau 


п2" 
n=1 


do not satisfy these conditions for all n > 1, but they do satisfy them for sufficiently large 
n. Hence, the series converges, by Lemma 4.3.4. E 


We will soon give several conditions concerning convergence of a series Уус an with 
nonnegative terms. According to Lemma 4.3.4, these results apply to series that have at 
most finitely many negative terms, as long as аһ is nonnegative and satisfies the conditions 
for n sufficiently large. 


When we are interested only in whether У 22, ап converges or diverges and not in its 
sum, we will simply say “> an converges” or “> an diverges.” Lemma 4.3.4 justifies 
this convention, subject to the understanding that Y ^ a; stands for bent an, Where К is an 
integer such that a; is defined for n > k. (For example, 


оо 


1 1 
у, (п —6)? stands for у, (п — 6)?” 


п=К 


where k > 7.) We write 35a, = oo (—оо) if Уа, diverges to oo (—оо). Finally, let us 
agree that 
oo oo 
у, a, and у, ап+] 
п=К п=К—] 
(where we obtain the second expression by shifting the index in the first) both represent the 


same series. 
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Cauchy’s Convergence Criterion for Series 


The Cauchy convergence criterion for sequences (Theorem 4.1.13) yields a useful criterion 
for convergence of series. 


Theorem 4.3.5 (Cauchy’s Convergence Criterion for Series) A series 
У`а, converges if and only if for every є > 0 there is an integer N such that 


lan + апі +: ат «€ if mznzN. (4.3.3) 
Proof In terms of the partial sums {Ay} of Y; an, 
ап + апі od dg = Аһ — An-1- 
Therefore, (4.3.3) can be written as 
[Аһ = An-i| «€ if т>п> М. 


Since Уа, converges if and only if {Ay} converges, Theorem 4.1.13 implies the conclu- 
sion. ш 


Intuitively, Theorem 4.3.5 means that ` а, converges if and only if arbitrarily long sums 
ап + anti + Баһ, mn, 


can be made as small as we please by picking п large enough. 


Example 4.3.3 Consider the geometric series > r” of Example 4.3.1. If |r| > 1, then 
£r") does not converge to zero. Therefore  ' r” diverges, as we saw in Example 4.3.1. If 
|r| < 1 and m > n, then 


|Am — Аһ| = [p ep Peer 


< п+1 1 р т—п—1 
< Ir? + |+ prt ds 
= pci < rp : 
l= 1—|r| 
If € > 0, choose N so that 
|г|У+! 
« €. 
Tes ir] 
Then (4.3.4) implies that 
Аһ = An| «€ if т>п> М. 
Now Theorem 4.3.5 implies that Y^ r” converges if |r| < 1, as in Example 4.3.1. ш 


Letting m = п in (4.3.3) yields the following important corollary of Theorem 4.3.5. 


Corollary 4.3.6 If $a, converges, then limp—+oo An = 0. 
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It must be emphasized that Corollary 4.3.6 gives a necessary condition for convergence; 
that is, > an cannot converge unless limy—oo dn = 0. The condition is not sufficient; X` аһ 
may diverge even if limp—oo dn = 0. We will see examples below. 


We leave the proof of the following corollary of Theorem 4.3.5 to you (Exercise 4.3.5). 


Corollary 4.3.7 If Уа, converges, then for each є > 0 there is an integer K such 
that 


oo 
Xan «e if k> К; 
n= 
that is, 
oo 
lim an = 0 
jim >), ý 
n=k 


Example 4.3.4 If |r| < 1, then 


oo oo oo |г|Ё 
k n—k k n 
т" = Ir r = |r rr) = Р 
№ 25 2 e 
n=k n=k n=0 
Therefore, if 
|г|К 
« €, 
l-r 
then 
<e if k>K, 


со 
2,0 
n=k 


which implies that іту. Уук r” = 0. 


Series of Nonnegative Terms 


The theory of series У` an with terms that are nonnegative for sufficiently large n is simpler 
than the general theory, since such a series either converges to a finite limit or diverges to 
oo, as the next theorem shows. 


Theorem 4.3.8 Ifa, > 0 forn > k, then Ya, converges if its partial sums are 
bounded, or diverges to oo if they are not. These are the only possibilities and, in either 
case, 


par sup {An |n > k}, 
=k 


where 
An =ак+ак+ d dg, n m К. 
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Proof Since A, = An—1 +n and dy > 0 (n > k), the sequence { A, } is nondecreasing, 
so the conclusion follows from Theorem 4.1.6(a) and Definition 4.3.1. 
a 
If a, > 0 for sufficiently large n, we will write $^ an < oo if ? : an converges. This con- 
vention is based on Theorem 4.3.8, which says that such a series diverges only if аһ = 
oo. The convention does not apply to series with infinitely many negative terms, because 
such series may diverge without diverging to оо; for example, the series У 20 (—1)” os- 
cillates, since its partial sums are alternately 1 and 0. 


Theorem 4.3.9 (The Comparison Test) Suppose that 
O<ar <br, nk. (4.3.5) 


Then 
(a) Уа, « oo if bn < оо. 
(b) Ур. = oif Y: an = co. 


Proof (a) If 
An — dp +4k+1 sca, and Bn = + р +e thn, п> К, 


then, from (4.3.5), 
An < Bn. (4.3.6) 


Now we use Theorem 4.3.8. If $^ b, < co, then ( В„} is bounded above and (4.3.6) implies 
that {An} is also; therefore, $^ a, < oo. On the other hand, if $` an = oo, then {An} is 
unbounded above and (4.3.6) implies that ( Bj) is also; therefore, $^ b, = oo. 


We leave it to you to show that (a) implies (b). и 


Example 4.3.5 Since 

r n 

—<r", nzl, 

n 
and $` r” < coif0 <r < 1, the series Y r"/n converges if 0 < г < 1, by the comparison 
test. Comparing these two series is inconclusive if r > 1, since it does not help to know 
that the terms of Ў ^ r”/n are smaller than those of the divergent series У”. If r < 0, the 
comparison test does not apply, since the series then have infinitely many negative terms. 


Example 4.3.6 Since 

r” « пт" 
and Yr" = oo ifr > 1, the comparison test implies that $^ nr" = œ ifr > 1. Compar- 
ing these two series is inconclusive if 0 < r < 1, since it does not help to know that the 
terms of 5 пг” are larger than those of the convergent series 5 ^ r”. и 
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The comparison test is useful if we have a collection of series with nonnegative terms 
and known convergence properties. We will now use the comparison test to build such a 
collection. 


Theorem 4.3.10 (The Integral Test) Let 


Cn = f(n), п> К, (4.3.7) 
where f is positive, nonincreasing, and locally integrable on [k, oo). Then 
У`с <оо (4.3.8) 
if and only if 
oo 
f f(x)dx < œ. (4.3.9) 
k 
Proof We first observe that (4.3.9) holds if and only if 
oo ntl 
у, f(x) dx < oo (4.3.10) 
n—k "^ 


(Exercise 4.3.9), so itis enough to show that (4.3.8) holds if and only if (4.3.10) does. From 
(4.3.7) and the assumption that f is nonincreasing, 


Сп = f(n-- 1) s f(x) s fin) 2c, nzxzncl, п> К. 


Therefore, 


п+1 ntl п+1 
Cn41 =f oa dx < f fides | Cndx — c4, п> К 
n n n 


(Theorem 3.3.4). From the first inequality and Theorem 4.3.9(a) with аһ = Cn+1 and 
b, — que f(x) dx, (4.3.10) implies that $7 c544 < oo, which is equivalent to (4.3.8). 
From the second inequality and Theorem 4.3.9(a) with a, — rd f(x) dx and b, = сь, 
(4.3.8) implies (4.3.10). ш 


Example 4.3.7 The integral test implies that the series 


1 1 1 
—, ————, d —— 
y» nP уЗ n(log n)? ап 2 nlogn [log(log n)]? 


converge if p > 1 and diverge if 0 « p < 1, because the same is true of the integrals 


f dx f dx Г ах 
—, — ———, and —— ——À5 
a x? a X(logx)? a xlogx [log(log x)]? 


if a is sufficiently large. (See Example 3.4.3 and Exercise 3.4.10.) The three series di- 
verge if p < 0: the first by Corollary 4.3.6, the second by comparison with the divergent 
series > 1/n, and the third by comparison with the divergent series > 1/(nlogn). (The 
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divergence of the last two series for р < 0 also follows from the integral test, but the 
divergence of the first does not. Why not?) These results can be generalized: If 


Lo(x) = х and L(X)-—log|Ly-iQ)]. k= 1, 


then 
Y 1 
Lo(n)Li(n) -+ Lk (п) [аа (1)]? 
converges if and only if p > 1 (Exercise 4.3.11). ш 


This example provides an infinite family of series with known convergence properties 
that can be used as standards for the comparison test. 

Except for the series of Example 4.3.7, the integral test is of limited practical value, 
since convergence or divergence of most of the series to which it can be applied can be 
determined by simpler tests that do not require integration. However, the method used to 
prove the integral test is often useful for estimating the rate of convergence or divergence 
of a series. This idea is developed in Exercises 4.3.13 and 4.3.14. 


Example 4.3.8 The series 


ы 1 

— 4.3.11 
КЗ к 43.11) 
converges if q > 1/2, by comparison with the convergent series У) 1/71?4, since 


1 1 


— < ——, > 1, 
(n?--n) n’a 


This comparison is inconclusive if q < 1/2, since then 


x 
pu С 0m 
and it does not help to know that the terms of (4.3.11) are smaller than those of a divergent 


series. However, we can use the comparison test here, after a little trickery. We observe 
that 


со 


X 1 1 
рои 704919, 
xd (п + 1)?4 үп 4 


апа 
1 1 


— < ————. 
(п + 14 (n?+n) 
Therefore, the comparison test implies that 


1 
—————— = оо, < 1/2. ш 
Эт m 4- / 
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The next theorem is often applicable where the integral test is not. It does not require the 
kind of trickery that we used in Example 4.3.8. 
Theorem 4.3.11 Suppose that an > 0 and b, > 0 forn > k. Then 
(a) Xoan <œ if b» «oo and Jim an/bn « oo. 


(b) ECL if EL and lim an/bn > 0. 


n—oo 


Proof (a) Іт, оо dn/bn < oo, then {an /bn} is bounded, so there is a constant М 
and an integer k such that 
an<Mb,, п> К. 


Since 3^ b, < oo, Theorem 4.3.3 implies that У`(МЬ,) < oo. Now Ya, < оо, by the 
comparison test. 


(b) If lim, ап/®һ > 0, there is a constant т and an integer k such that 


an > mbn, п> К. 


Since Y, b, = oo, Theorem 4.3.3 implies that X` (mb) = oo. Now $` an = оо, by the 
comparison test. " 


Example 4.3.9 Let 


1 2 + sinnz/6 
* i = ат апа Уа, = 250 1) we 


Then 
an _ 2+ sinnz/6 
b,  (L+1/n)P(1—1/n)@’ 
SO а а 
lim — —3 and lim “=1. 
n—oo b, noo Dn 


Since > b, < oo if and only if p + q > 1, the same is true of 37 an, by Theorem 4.3.11. 
a 


The following corollary of Theorem 4.3.11 is often useful, although it does not apply to 
the series of Example 4.3.9. 


Corollary 4.3.12 Suppose that ay > 0 and b, > 0 for n > k, and 


where 0 < L < oo. Then Y an and Y bn converge or diverge together. 
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Example 4.3.10 With this corollary we can avoid the kind of trickery used in the 
second part of Example 4.3.8, since 


1 1 1 
n—oo (n? + n) n24 поо (1 + 1/n)4 
SO 
1 


1 
Lame "US La 


converge or diverge together. 


The Ratio Test 


It is sometimes possible to determine whether a series with positive terms converges by 
comparing the ratios of successive terms with the corresponding ratios of a series known to 
converge or diverge. 


Theorem 4.3.13 Suppose that аһ > 0, bn > 0, and 


n1 _ Dna 


е (4.3.12) 

Then 
(a) Sian « oo if 3b, < co. 
(b) $ bn = 6o04f an = оо. 
Proof Rewriting (4.3.12) as 

аһ+1 аһ 

< "s 3 
bn+1 Е bn 


we see that {an / b; is nonincreasing. Therefore, lim, , оо ап /bn < оо, and Theorem 4.3.11 (a) 
implies (a). 

To prove (b), suppose that $` an = оо. Since {a,/by} is nonincreasing, there is a 
number p such that bn > pan for large n. Since У (pas) = oo if Уа, = оо, Theo- 
rem 4.3.9(b) (with a, replaced by pan) implies that УЬ, = оо. ш 


We will use this theorem to obtain two other widely applicable tests: the ratio test and 
Raabe’s test. 


Theorem 4.3.14 (The Ratio Test) Suppose thatan > 0 forn > k. Then 


(a) Xan < oo if lim, soo An41/an < 1. 
(b) Уа, = 00 if lim, о Яп+1/ап > 1. 


If 


(4.3.13) 


then the test is inconclusive; that is, Y^ аһ may converge or diverge. 
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Proof (a) If 
—— @п+1 
lim 
n—00 Ay 


< 1, 


there is a number r such that 0 < r < 1 and 


@п+1 
ап 


for п sufficiently large. This can be rewritten as 


pnt 


аһ+1 
< А 
аһ y" 


Since $^ r” < oo, Theorem 4.3.13(a) with b, = r” implies that Y; an < oo. 
(b) 1f 


there is a number r such that r > 1 and 
an+1 
— > 
ап 
for п sufficiently large. This can be rewritten as 
ап+1 pt 
> 7 
аһ r? 


Since $^ r” = oo, Theorem 4.3.13(b) with a, = r” implies that $^ b, = oo. п 


To see that no conclusion сап be drawn if (4.3.13) holds, consider 


1 


an = E— 
2. " nP 


This series converges if p > 1 or diverges if p < 1; however, 


for every p. 


Example 4.3.11 If 


then 


which assumes the values 37/2, 27/3, r/2, and 2r, each infinitely many times; hence, 


L— @п+1 A an+1 r 
lim =2r and lim = 
n>œ© An n—oo ün 2 


Therefore, X` an converges if 0 < r < 1/2 and diverges if r > 2. The ratio test is 
inconclusive if 1/2 « r « 2. H 
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The following corollary of the ratio test is the familiar ratio rest from calculus. 


Corollary 4.3.15 Suppose that a, > 0 (n > k) and 


: аһ+1 
lim 


поо Ay 


=L; 


Then 
(a) $`а„<соу1<1. 
(b) X ar=œifL>l1. 


The test is inconclusive if L = 1. 


Example 4.3.12 The series $ an = Y; nr" ! converges if 0 < г < 1 or diverges if 


r > 1, since 
a n 4 1)r” 1 
anti = (n t Dr? = 1 + — |, 
ап nr”! n 
so 
А аһ+1 
lim —— = 


n>œ© Ay 


Corollary 4.3.15 is inconclusive if r = 1, but then Corollary 4.3.6 implies that the series 
diverges. ш 
The ratio test does not imply that > an < оо if merely 


an+1 
an 


< 1 (4.3.14) 


for large n, since this could occur with іт, оо арфі /ап = 1, in which case the test is 
inconclusive. However, the next theorem shows that $^ an < оо if (4.3.14) is replaced by 


the stronger condition that 
an+1 


an n 
for some p > 1 and large n. It also shows that > an = oo if 


a 
cep Siz 


ап п 


for some q < 1 and large n. 


Theorem 4.3.16 (Raabe’s Test) Suppose that аһ > 0 for large n. Let 
M= fig п (2-1) and m= tim n (A. 1). 
nee ап n> ап 
Тһеп 


(a) Xa, «oo if M < –1. 
(b) Xa, = oo if m > —1. 


The test is inconclusive if m € —1 < M. 
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Proof (a) We need the inequality 
1 
——— > 1 
(1+ х)? 
This follows from Taylor’s theorem (Theorem 2.5.4), which implies that 


EN 1 pet) 3 
mo ors 


2(1+суР+* ' 
where 0 < c < x. (Verify.) Since the last term is positive if p > 0, this implies (4.3.15). 


— px, х> 0, р> 0. (4.3.15) 


Now suppose that М < —p < —1. Then there is an integer k such that 


n (8 -1) ер n>k, 


an 
so 
ee 1— Р п> К. 
аһ п 
Непсе, 
Qn+1 1 


mH c, He 
an (1+ 1/n)P E 


as can be seen by letting x — 1/n in (4.3.15). From this, 


1 1 
anti X LL —, n 25 k. 
an (n+1)?/ n? 


Since У 1/n? < oo if p > 1, Theorem 4.3.13(a) implies that $^ an < оо. 
(b) Here we need the inequality 


(1-х) «1—qx, 0<х<1, O0<q<l. (4.3.16) 


This also follows from Taylor's theorem, which implies that 


2 
(1-х) 21-ax t q(a - 001 – oe, 


where 0 « c « x. 
Now suppose that —1 < —q < m. Then there is an integer k such that 
n (4-1) >-q, п> К, 
аһ 


SO 
аһ+1 4 


аһ 
If q < 0, then ` an = оо, by Corollary 4.3.6. Hence, we may assume that 0 < q < 1, so 
the last inequality implies that 


q 
nl > T ‚п> К, 
аһ п 


214 Chapter 4 Infinite Sequences and Series 


as can be seen by setting x = 1/7 in (4.3.16). Hence, 


1 1 
an+1 alg Pas 
an n4 | (n—1)4 


Since У) 1/n4 = oo if q < 1, Theorem 4.3.13(b) implies that X` an = оо. L| 


Example 4.3.13 If 


n! 
üg — — a > 0, 
2s " КЗ лю куно SEX 
Шеп 
: an+1 $ n+1 
lim = lim = 
noo An noa+n 


so the ratio test is inconclusive. However, 


1, 


so Raabe's test implies that 3 an < oo if a, > 2 and J` an = oo if 0 < a < 2. Raabe's 
test is inconclusive if à, = 2, but then the series becomes 


n! 1 
2D = sup 
which we know is divergent. 


Example 4.3.14 Consider the series $5 аһ, where 
E (m!)? 
© Qo + 1)--- (a + m)B(B + 1)--- (B +m) 


2m 


and 
E (m3? (m + 1) 
т Sep) a +m BE +I) Bm)’ 


with 0 <a < В. Since 
1 2 
2m (S284 1) am (13-1) A 
d2m В+т+1 В+т+1 


+ 1 2 1 
Qm p (2 2 1) ото (л) ет, 
ü2m41 atm+l о +т +1 


апа 


we have 


lim л (== — ) = —2a and limn (== — 1) = —2£. 


поо аһ n> ап 


Raabe's test implies that $` an < oo if œ > 1/2 and $a, = oo if B < 1/2. The test is 
inconclusive if 0 < œ < 1/2 < £. [| 
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The next theorem, which will be useful when we study power series (Section 4.5), con- 
cludes our discussion of series with nonnegative terms. 


Theorem 4.3.17 (Cauchy’s Root Test) Ifa, > 0 forn > k, then 
(a) Уа, < oo if im, +00 al" « 1. 
(b) Ya, = oo if lim, oo al/" > 1. 


The test is inconclusive if Timp—+oo al/" = 1. 


Proof (a) If їт, оо al/" < 1, there is an r such that 0 < г < 1 and al/" < r for 
large n. Therefore, a; < r” for large n. Since У)” < оо, the comparison test implies that 
Уа, < оо. 


(b) If lim, оо ai!” > 1, then al/" > 1 for infinitely many values of n, so 3a, = oo, 
by Corollary 4.3.6. E 


Example 4.3.15 Cauchy’s root test is inconclusive if 


У аһ = сез 


because then 


E 1 1/n 
lim а1/" = lim (5) = lim exp (—4 log) =1 
n—oo n—oo n 


поо \ nP 


for all p. However, we know from the integral test that $7 1/n? < oo if p > 1 and 
Y 1/пР = wif p <1. 


Example 4.3.16 If 


an = де Tg 
а=); 1 


Шеп 


um аһ = lim (2+ sin 1 г = 3r, 


апа so Уа, < оо ifr < 1/3 and Уа, = œ ifr > 1/3. The test is inconclusive if 
r = 1/3, but then |dgm+2| = 1 for m > 0, so Уа, = œ, by Corollary 4.3.6. 
Absolute and Conditional Convergence 


We now drop the assumption that the terms of ` an are nonnegative for large n. In this 
case, $^ a, may converge in two quite different ways. The first is defined as follows. 


Definition 4.3.18 A series Ya, converges absolutely, or is absolutely convergent, if 
X |an| < oo. 
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Example 4.3.17 A convergent series У` a, of nonnegative terms is absolutely conver- 
gent, since ` an and У |an| are the same. More generally, any convergent series whose 
terms are of the same sign for sufficiently large n converges absolutely (Exercise 4.3.22). 


Example 4.3.18 Consider the series 


sinnô 
у, , (4.3.17) 


where @ is arbitrary and p > 1. Since 


nP 


sinn | 1 
< 


апа ` 1/n? < œ if p > 1, the comparison test implies that 


Э 


Therefore, (4.3.17) converges absolutely if p > 1. 


sinnô 


|<, р> 1. 
пР 


Example 4.3.19 If 0 < р < 1, then the series 


ci 
m 7. 


does not converge absolutely, since 
1 


(-1)" 
|S T2 5 = 


However, the series converges, by the alternating series test, which we prove below. " 


Any test for convergence of a series with nonnegative terms can be used to test an arbi- 
trary series У` a, for absolute convergence by applying it to У |a; |. We used the compar- 
ison test this way in Examples 4.3.18 and 4.3.19. 


Example 4.3.20 To test the series 


п п! 
ҮЗ ЫЗ Cm ШОШ 


for absolute convergence, we apply Raabe’s test to 


n! 
а = vos стт. 


From Example 4.3.13, Y |an| < oo if o, > 2 and Y! |as| = œ ifo < 2. Therefore, X` an 
converges absolutely if œ > 2, but not if æ < 2. Notice that this does not imply that Y ^ an 
diverges if o < 2. ш 
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The proof of the next theorem is analogous to the proof of Theorem 3.4.9. We leave it to 
you (Exercise 4.3.24). 


Theorem 4.3.19 If $a, converges absolutely, then $^ аһ converges. 
For example, Theorem 4.3.19 implies that 
Y sinn 
пр 


converges if p > 1, since it then converges absolutely (Example 4.3.18). 


The converse of Theorem 4.3.19 is false; a series may converge without converging abso- 
lutely. We say then that the series converges conditionally, or is conditionally convergent; 
thus, > :(—1)" /n? converges conditionally if0 < p < 1. 


Dirichlet’s Test for Series 


Except for Theorem 4.3.5 and Corollary 4.3.6, the convergence tests we have studied so 
far apply only to series whose terms have the same sign for large n. The following theo- 
rem does not require this. It is analogous to Dirichlet's test for improper integrals (Theo- 
rem 3.4.10). 


Theorem 4.3.20 (Dirichlet's Test for Series) The series Xy dnbn con- 
verges if lim oo dn = 0, 


У |an+1 — an| < оо, (4.3.18) 


and 
ре + ра + | <M, п> К, (4.3.19) 


for some constant М. 
Proof The proof is similar to the proof of Dirichlet’s test for integrals. Define 
Bn = by + Бр tess thn, п> К 

and consider the partial sums of ? 77.4 dnbn: 

Sn = akby + ak+1bk+1 d + аһ, nm К. (4.3.20) 
By substituting 

by = By and by = B,—B,.1, п> К +1, 
into (4.3.20), we obtain 

Sn = ak Bk + a¢+1(Bet+i — Вк) + +++ + an(Bn — Bn-1), 

which we rewrite as 


Sn = (ak — акъ) Bk + (акъ = ak+2)Bk+1 ++ 


4.3.21 
EE (an—1 — dg) Bn—1 + an Bn. ( ) 
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(The procedure that led from (4.3.20) to (4.3.21) is called summation by parts. It is analo- 
gous to integration by parts.) Now (4.3.21) can be viewed as 


Sn = Tn-1 + an Bn, (4.3.22) 
where 
Th-1 = (ак — O41) Be + (акъ — ak+2)Bk+1 ++ (ani — an) Bai 
that is, { Tn } is the sequence of partial sums of the series 
оо 
У (а; —4j41)Bj. (4.3.23) 
j-k 


Since 
(a; —aj41)Bj| € Mla; —a;+1| 


from (4.3.19), the comparison test and (4.3.18) imply that the series (4.3.23) converges 
absolutely. Theorem 4.3.19 now implies that {Т, } converges. Let T = іт, оо Tn. Since 
{Bn} is bounded and lim, оо ап = 0, we infer from (4.3.22) that 


lim S, = lim Т1 + lim a,B, = T +0=T. 
noo n—oo no 
Therefore, У) dn bn converges. ш 


Example 4.3.21 To apply Dirichlet’s test to 


у, сЕ с 0 + Кл (К = integer), 


= n+ (—1) , 
we take í 
= arC and b, = sinnô. 
Then іт, оо ап = 0, and 
3 
— < ———— 
lan+1 — an| n(n —1) 


(verify), so 
у, [йп+1 — an| < оо. 


Now 
В, = sin20 + sin30 +---+ sinn. 


To show that { В„} is bounded, we use the trigonometric identity 


2 
2sin(0/2) 


cos (r — 1) 0 — cos (r + 1) 0 6 42k 
Mor EN MEM CM: a л, 


sinr = 
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to write 


_ (cos 30 — cos 20) + (cos 20 — cos 20) Tec (cos (n — i) 0 — cos(n + 1)0) 


n 


2sin(0/2) 
cos 30 — cos(n + 1)0 
2 sin(0/2) | 
which implies that 
1 
B,| € |———— |, > 
[В| = sin(0/2) da 


Since {аһ} and {by} satisfy the hypotheses of Dirichlet's theorem, $^ a,b, converges. Ш 
Dirichlet's test takes a simpler form if (a5) is nonincreasing, as follows. 


Corollary 4.3.21 (Abel’s Test) The series Y; anbn converges if an41 < an for 


n > k, limy-so0 dn = 0, and 
|b + Бет bb <M, п> К, 


for some constant М. 


Proof Ifan+ı < an, then 


m m 


У lana — asl = У (an — an41) = аат. 


n=k n=k 
Since liMm—>oo 4m+1 = 0, it follows that 


оо 


У lan+1 – an| = ак < оо. 
n=k 
Therefore, the hypotheses of Dirichlet's test are satisfied, so Y` an b, converges. ш 


Example 4.3.22 The series 


sinnO 
У; пр’ 
which we know is convergent if р > 1 (Example 4.3.18), also converges if 0 < р < 1. 
This follows from Abel’s test, with a, = 1/n? and b, = sinn0 (see Example 4.3.21). M 


The alternating series test from calculus follows easily from Abel’s test. 


Corollary 4.3.22 (Alternating Series Test) The series У (—1)" an converges 
ifO < ап+1 < an and lima soo dn = 0. 


220 Chapter 4 Infinite Sequences and Series 


Proof Let b, = (—1)"; then {|B,|} is a sequence of zeros and ones and therefore 
bounded. The conclusion now follows from Abel’s test. ш 


Grouping Terms in a Series 


The terms of a finite sum can be grouped by inserting parentheses arbitrarily. For example, 
(1+7) + (6+5) +4=(1+7+6) + (5 + 4) = (1+7) + (6+5 + 4). 


According to the next theorem, the same is true of an infinite series that converges ог 
diverges to +00. 


Theorem 4.3.23 Suppose that У) dn = A, where —oo < A < oo. Let {п ;}% be 
an increasing sequence of integers, withn, 7 k. Define 


by — ag can, 
b2 = dg 41 d + an, 


b, = n, 141 T t n, 


Then 


X bn = А. 
ja 


Proof If T, is the rth partial sum of y» bn, and {Ал} is the nth partial sum of 
sa as, then 
T, = bi + bo +++: + Б, 
= (01 +++ + ani) + (ап+1 +++ an) ++ (Gn, oi b a) 
= Án,- 


Thus, {T,} is a subsequence of { An}, so т, зоо T, = т, оо An = A by Theorem 4.2.2. 
ш 


Example 4.3.23 If > 4(—1)"a, satisfies the hypotheses of the alternating series 
test and converges to the sum S, Theorem 4.3.23 enables us to write 


k oo 
$ = У)" + (CDH У \(ак+әу-1 — ak42;) 


n=0 j=l 


and E Бы 2 
$ = "» Ou + (2107 |а = X akta; — k42j-1) |. 
n=0 Ј=1 
ye 


Since 0 < a444 < an, these two equations imply that S— S% is between 0 and (—1 ак+1. 
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Example 4.3.24 Introducing parentheses in some divergent series can yield seem- 
ingly contradictory results. For example, it is tempting to write 


У" =d-)+0-)+---=0+04+-- 
n=1 


and conclude that У (— 1)" = 0, but equally tempting to write 


У)" =1- (1-1) (1-1) 
n=1 
—-1-0-0-... 


and conclude that ye 1" = 1. Of course, there is no contradiction here, since 
Theorem 4.3.23 does not apply to this series, and neither of these operations is legitimate. 


Rearrangement of Series 
A finite sum is not changed by rearranging its terms; thus, 
19+3+7=1+7+3=3+1+7=3+7+1=7+1+3= 7+3 +1. 


This is not true of all infinite series. Let us say that }` b, is a rearrangement of Y 7 an if 
the two series have the same terms, written in possibly different orders. Since the partial 
sums of the two series may form entirely different sequences, there is no apparent reason 
to expect them to exhibit the same convergence properties, and in general they do not. 


We are interested in what happens if we rearrange the terms of a convergent series. We 
will see that every rearrangement of an absolutely convergent series has the same sum, but 
that conditionally convergent series fail, spectacularly, to have this property. 


Theorem 4.3.24 If $>; b, is a rearrangement of an absolutely convergent series 
ban аһ, then X ca bn also converges absolutely, and to the same sum. 


Proof Let 
An = |a| + ]a2| +++ |0) and B, = |bi| + |b2| +--+ + [bs]. 


For each n > 1, there is an integer kn such that b1, b2, ..., bn are included among a1, a2, 
D, Akp» SO В, < Ар. Since {An} is bounded, so is {Bn}, and therefore У |b, | < oo 
(Theorem 4.3.8). 


Now let 


An — did d2 d dg, Bn = bip + +: + bg, 


oo oo 
A=) аһ and B=} by 
n=1 n=1 
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We must show that A = B. Suppose that € > 0. From Cauchy’s convergence criterion for 
series and the absolute convergence of Ў an, there is an integer № such that 


|ам+11 + lan+2| ++ + |а| «6€, К>1. 


Choose № so that а], a2, ..., ay are included among by, 55, ..., Рм. Їп > №, 
then A, and B, both include the terms a4, a2, ..., ам, which cancel on subtraction; thus, 
| An — В, | is dominated by the sum of the absolute values of finitely many terms from > a; 
with subscripts greater than N. Since every such sum is less than є, 


|А, — Bal «e if n>N. 
Therefore, іт, оо (An — Bn) = 0 and A= B. [| 


To investigate the consequences of rearranging a conditionally convergent series, we 
need the next theorem, which is itself important. 


Theorem 4.3.25 If P = {аһ} and О = {аһ} are respectively the subsequences 
of all positive and negative terms in a conditionally convergent series Y an, then 


oo oo 
X an =œ and Уа, = —oo. (4.3.24) 


і=1 Ј=1 


Proof If both series in (4.3.24) converge, then У` a, converges absolutely, while if one 
converges and the other diverges, then X` a, diverges to oo or —oo. Hence, both must 
diverge. ш 


The next theorem implies that a conditionally convergent series сап be rearranged to 
produce a series that converges to any given number, diverges to «oo, or oscillates. 


Theorem 4.3.26 Suppose that У)? , ап is conditionally convergent and p and v are 
arbitrarily given in the extended reals, with ш < v. Then the terms of У у an can be 
rearranged to form a series У? у bn with partial sums 


Bn = by ++: +0, n=l, 


such that 
lim B, =» and lim B, = p. (4.3.25) 


n—oo noo 


Proof We consider the case where jz and v are finite and leave the other cases to you 
(Exercise 4.3.36). We may ignore any zero terms that occur in У ап. For convenience, 
we denote the positive terms by P = {a; } and and the negative terms by О = {—8;}?. 
We construct the sequence 


(ba = {01,...,Q@m,,—B1,---,—Bny, Om +1, -< -o me, T Pus s nass) 
(4.3.26) 
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with segments chosen alternately from P and Q. Let mg = no = 0. If k > 1, let тк and 
ny be the smallest integers such that my > my, nik > пк—\, 


Nk-1 


mk Mk Nk 
у-у) Ву >, апа es – УВ; <и. 
j=l j=l 


і=1 i=1 


Theorem 4.3.25 implies that this construction is possible: since $^ a; = У f; = оо, we 
can choose ту and nx so that 


тк пк 
у o; and у В; 
ї=тк—\| J=Nk-1 


are as large as we please, no matter how large тұ; and пр are (Exercise 4.3.23). Since 
тк and nx are the smallest integers with the specified properties, 


V < Впр <0 Бот, k >= 2, (4.3.27) 
and 
HL — Bn, < Bnyan, SH, k > 2. (4.3.28) 
From (4.3.26), b, < Oif my + пру < n € my +n x, SO 
Bmyny € Bn € Bmyyny л. Mk +^k-1 € n € my t ny, (4.3.29) 
while b, > Oif my + пр «n € тер +k, SO 
Втк+пк € Bn € Bogs ytng, Mk t nk E n < тфу + ny. (4.3.30) 
Because of (4.3.27) and (4.3.28), (4.3.29) and (4.3.30) imply that 
U — Pny <Bn<V+Qm,, Mk ny € n € my t ny, (4.3.31) 
and 
IL — Bn, < Bn < V ат, Mk nk E n E mie c ny. (4.3.32) 


From the first inequality of (4.3.27), В, = v for infinitely many values of n. However, 
since limj—+o0 0; = 0, the second inequalities in (4.3.31) and (4.3.32) imply that if € > 0 
then B, > v + є for only finitely many values of n. Therefore, lim, оо B, = v. From 
the second inequality in (4.3.28), В, < џ for infinitely many values of n. However, since 
limj—+oo Ву = 0, the first inequalities in (4.3.31) and (4.3.32) imply that if € > 0 then 


B, < u — є for only finitely many values of n. Therefore, lim, ,44 Bn = и. ш 


Multiplication of Series 


The product of two finite sums can be written as another finite sum: for example, 


(ao + ау + a2)(bo + bi + b2) = aobo + аор + agb; 
+aıbo + ару + a1 b2 
+arbo + a2b, + алб», 
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where the sum on the right contains each product a; b; (i, j = 0, 1, 2) exactly once. These 
products can be rearranged arbitrarily without changing their sum. The corresponding 
situation for series is more complicated. 


Given two series 


oo oo 
у, an and у, b, 
n=0 n=0 


(because of applications in Section 4.5, it is convenient here to start the summation index 
at zero), we can arrange all possible products a;b; (i, j > 0) іп a two-dimensional array: 


aobo 
a1bo 
азо 
азро 


agbi 
aıbı 
abi 
a3bı 


agb2 
а1Ь» 
a2b2 
a3b2 


agb3 
a1b3 
a2b3 
a3b3 


(4.3.33) 


where the subscript on a is constant in each row and the subscript on b is constant in each 
column. Any sensible definition of the product 


à) 


clearly must involve every product in this array exactly once; thus, we might define the 
product of the two series to be the series Уу-у pn, where {pn} is a sequence obtained 
by ordering the products in (4.3.33) according to some method that chooses every product 
exactly once. One way to do this is indicated by 


aobo — 

aibo < 
| 

або — 

a3bo {= 


(4.3.34) 
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and another by 


aobo = aobı aob2 => aob3 aob4 
"4 "A 4 p 
aıbo aıbı а1Ь» aıb3 
Y Z "4 Z 
a5bo abi аЬ» a2b3 ses (4.3.35) 
"4 d 
d3bo азЬ\ азЬ» a3b3 
4 Z 
a4bo 


There are infinitely many others, and to each corresponds a series that we might consider 
to be the product of the given series. This raises a question: If 


oo oo 
a= A and b= B 
n=0 n=0 


where A and B are finite, does every product series У) o Pn constructed by ordering the 
products in (4.3.33) converge to AB? 


The next theorem tells us when the answer is yes. 


Theorem 4.3.27 Let 


оо оо 
Уа =A апа » bn =B, 
n=0 n=0 


where A and B are finite, and at least one term of each series is nonzero. Then У у Pn = 
AB for every sequence {pn} obtained by ordering the products in (4.3.33) if and only if 
Xan and Y, bn converge absolutely. Moreover, in this case, X рп converges absolutely. 


Proof First, let {p,} be the sequence obtained by arranging the products {a;b j accord- 
ing to the scheme indicated in (4.3.34), and define 
An = ao di tas, An = |а0| + Jail +++ + lanl, 


Bn = bo + bi +-+: by, = |bo| + |bi| +--+ + lbn], 


Bn 
Pa = po + pisc pn, Pn = |р| + 1р ++ |р. 


From (4.3.34), we see that 
Po = АоВо, Рз = 4ıBı, Рв = А2 Вә, 


and, in general, 
Pom41)2-1 = Am Bg. (4.3.36) 
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Similarly, 
P n4iy2-1 = АтВт. (4.3.37) 


If 3 |а| < oo and Y? |bn| < оо, then {Am Bm} is bounded and, since Pm < P (m41)2-1; 
(4.3.37) implies that {P m} is bounded. Therefore, У | pn| < оо, so У) pn converges. Now 


oo 

у, рп = lim P, (by definition) 

n=0 noo 
= um Pqn41ya (by Theorem 4.2.2) 
= lim AmBm (from (4.3.36) 

m-—»oo 
= ( lim Am) ( lim Bm) (by Theorem 4.1.8) 
т->со moo 


Since any other ordering of the products in (4.3.33) produces a a rearrangement of the 
absolutely convergent series > 7.9 Pn, Theorem 4.3.24 implies that $^ |gn| < oo for every 
such ordering and that У o dn = AB. This shows that the stated condition is sufficient. 


For necessity, again let 3 7* o Pn be obtained from the ordering indicated in (4.3.34), 
and suppose that У) Pn and all its rearrangements converge to AB. Then У) p, must 
converge absolutely, by Theorem 4.3.26. Therefore, (P,,» ,) is bounded, and (4.3.37) 
implies that {Am} and {B m} are bounded. (Here we need the assumption that neither У) an 
nor У) b, consists entirely of zeros. Why?) Therefore, У |an| < oo and У |.| < оо. Ш 


The following definition of the product of two series is due to Cauchy. We will see the 
importance of this definition in Section 4.5. 


Definition 4.3.28 The Cauchy product of Y а, and У уЬ, is У) сп, Where 
Cn = aobg + a4bg 1 +++ aga b1 + agbo. (4.3.38) 
Thus, c; is the sum of all products a;b ;, where i > 0, j > 0, and i + j = n; thus, 


n n 
Cn = X. arbn-r = }ў таа (4.3.39) 
r=0 r=0 m 


Henceforth, (> аһ) (155-9 bn) should be interpreted as the Cauchy product. Notice 


(SeS) 2) 


and that the Cauchy product of two series is defined even if one or both diverge. In the case 
where both converge, it is natural to inquire about the relationship between the product of 
their sums and the sum of the Cauchy product. Theorem 4.3.27 yields a partial answer to 
this question, as follows. 
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Theorem 4.3.29 If У а, and 375.9 bn converge absolutely to sums A and B, 
then the Cauchy product of У аһ and Y 4.9 bn converges absolutely to AB. 


Proof Let C, be the nth partial sum of the Cauchy product; that is, 
Cn = co c C1 b ib Cn 


(see (4.3.38)). Let $O? o Pn be the series obtained by ordering the products (a;, bj} ac- 
cording to the scheme indicated in (4.3.35), and define P, to be its nth partial sum; thus, 


Pa = po + pic pa. 


Inspection of (4.3.35) shows that c, is the sum of the n + 1 terms connected by the diagonal 
arrows. Therefore, C, = Pm,,, where 
n(n + 3) 

z 


From Theorem 4.3.27, іт, оо Pm, = АВ, so іт, оо Cn = AB. To see that > |cn| < 
oo, we observe that 


my, =14+24+---4¢(v74+)-1l= 


mn 


n 
у, ler] < у, |р» | 
r=0 s=0 
and recall that Y^ | ps| < оо, from Theorem 4.3.27. a 
Example 4.3.25 Consider the Cauchy product of У) o r” with itself. Here аһ = 


bn = r” and (4.3.39) yields 


1 п—1 „1 


Cn =r rtrt pee pr tel p pp? = (n+ Dr", 


so 


oo 2 oo 
p ”) = G +1)”. 
n=0 


n=0 


Since 
" 1 
у r” = ——, || < 1, 
l-r 


and the convergence is absolute, Theorem 4.3.29 implies that 


= 1 
Xa+” = dy Ir} < 1. 
=0 


Example 4.3.26 If 


oo oo ü oo В" 
Xa-) аа Ya, 
0 aco e 


n=0 n=0 ` n 


БЫ 
8 
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then (4.3.39) yields 


(9+ В)". 
п! 


thus, 
p “| (> " rem (ar rp | (4.3.40) 


You probably know from calculus that У 20 x" /n! converges absolutely for all x to e”. 
Thus, (4.3.40) implies that 

а еВ — ett B 
a familiar result. ш 


The Cauchy product of two series may converge under conditions weaker than those 
of Theorem 4.3.29. If one series converges absolutely and the other converges condi- 
tionally, the Cauchy product of the two series converges to the product of the two sums 
(Exercise 4.3.40). If two series and their Cauchy product all converge, then the sum of 
the Cauchy product equals the product of the sums of the two series (Exercise 4.5.32). 
However, the next example shows that the Cauchy product of two conditionally convergent 
series may diverge. 


Example 4.3.27 If 

(— 1) +1 

NE 

then У) 9 an and У? o bn converge conditionally. From (4.3.39), the general term of 
their Cauchy product is 


an = br = 


“ум 1)7+1( 1)” r+1 seS 1 1 
(£e Vr tivn-r tl Е c Jr+ivn-rtl 


so 


n 
1 n+1 
len | = у, а Е 
4o yn+1Iyn+1 ntl 
Therefore, the Cauchy product diverges, by Corollary 4.3.6. 


4.3 Exercises 


1. Prove Theorem 4.3.2. 
2. Prove Theorem 4.3.3. 


3. (a) Prove: Ifan = b, except for finitely many values of n, then X` an and Y, bn 
converge or diverge together. 


10. 
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(b) Let bn, = ак for some increasing sequence {nx }$° of positive integers, and 
bn = 0 ifn is any other positive integer. Show that 


со 


со 
У^, апа > a 
n=1 


n=1 


diverge or converge together, and that in the latter case they have the same sum. 
(Thus, the convergence properties of a series are not changed by inserting zeros 
between its terms.) 


(a) Prove: If Y; an converges, then 


lim (an + an+1 +--+ an4r)=0, FS 0, 
поо 


(b) Does (a) imply that У a, converges? Give a reason for your answer. 
Prove Corollary 4.3.7. 


(a) Verify Corollary 4.3.7 for the convergent series Y; 1/n? (p > 1). HINT: See 
the proof of Theorem 4.3.10. 
(b) Verify Corollary 4.3.7 for the convergent series У ,(—1)" /n. 


Prove: If 0 < b, < an < bn+1, then Уа, and Y^ b, converge or diverge together. 


Determine convergence or divergence. 
мп2 —] 1 

(a) У —— (b) 6—1 
Мп? +1 n? [1 + 4 sin(nz/4)] 
1 — e™” logn л 

(с) 5)" (d) у) — 
‚Л 1 л 

(e) 5 зп = (f) 5, = tan — 


(g Y; c cot (hb) 3; 2" 


Suppose that f(x) > 0 for x > К. Prove that ie f (x) dx < oo if and only if 


o9 п+1 
> f(x) dx < oo. 


n-k"*" 
HINT: Use Theorems 3.4.5 and 4.3.8. 


Use the integral test to find all values of p for which the series converges. 


n n? sinhn 
(8) 0 =P (b) 5, o3 кар (LA come 
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11. 


12. 


13. 


14. 


15. 


Let Ln be the nth iterated logarithm. Show that 


1 
2 Lo(n)Li(n) +++ Li(n) (Levi)? 
converges if and only if p > 1. HINT: See Exercise 3.4.10. 
Suppose that g, g’, and (g^)? — gg” are all positive on [R, oo). Show that 


/ 
EQ us 
g(n) 
if and only if іт, зоо g(x) < oo. 
Let 
2 1l 
50р) = =, Pet. 
n=1 
Show that 
1 ы 1 
—_______. < S(p) – — < ——___.. 
(p- Dw c nr 550 2. n? ~ (p-IN?-1 


HINT: See the proof of Theorem 4.3.10. 


Suppose that f is positive, decreasing, and locally integrable on [1, со], and let 


gcc S aye T Т 
Lo- 


(a) Show that {an} is nonincreasing and nonnegative, and 
0 « lim an < f(1). 
n—oo 
(b) Deduce from(a) that 


1 1 1 
y = lim (repe pee овп) 
2 n 


n—oo 3 


exists, and 0 < y < 1. (у is Euler's constant; y = 0.577.) 


Determine convergence or divergence. 


SANE 2+ sinnô (b) 3; 3n e» 


n2 + sinn 


1 
(с) у е" cosh пр (p > 0) (а) у, en 


(е) yo n + logn (f) Y (1 DUM 


n?logn 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 


24. 
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Let Ln be the nth iterated logarithm. Prove that 
1 
лты ҮТТЕ or 
converges if and only if there is at least one nonzero number in (qo. 41....,4т} and 
the first such is positive. HINT: See Exercises 4.3.11 and 2.4.42(b). 


Determine convergence or divergence. 


(a) 5 2 + sin 209 (b) Y me 1) 
3— йш n + (—1)" 
(c) PTS n(n 4- 1) (d) FE EE n(n 4- 1) 


Determine convergence or divergence, with r > 0. 


(9355 (b) Уә «У 
COS: Qn +1)! (e) D 


Determine convergence or divergence. 
(2n)! (3n)! 
Bici b _ = _ 
(а) у, 221 (n1)? (b) 5, 39nY( + Din +3)! 


2"n! a(a+1)---(@a+tn—1) 
„35е х= УЗ ус Gray (029 
Determine convergence or divergence. 
n" (2 + (-1)") 1 + sin3n0 |" 
(aye e) X (=) 


(c) Y +1) (- + MUT (d) 3 ( E 3! 


Give counterexamples showing that the following statements are false unless it is 

assumed that the terms of the series have the same sign for п sufficiently large. 

(a) Ya, converges if its partial sums are bounded. 

(b) Ifb, = 0 forn > К and lim, оо dn/bn = L, where 0 < L < oo, then Y; an 
and J` bn converge or diverge together. 

(c) Ifa, # 0 and lim, 4n+1/4n < 1, then X` an converges. 

(d) Ifa, £ 0 and lim, soon [(an+1/an) — 1] < —1, then Y^ an converges. 

Prove: If the terms of a convergent series » аһ have the same sign for n > k, then 

Ў an converges absolutely. 


Suppose that a, > 0 for n > m and $5 a, = оо. Prove: If N is an arbitrary integer 
> m and J is an arbitrary positive number, then x an > J for some positive 


integer К. 
Prove Theorem 4.3.19. 
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25. 


26. 


27. 


28. 


29. 
30. 


31. 


32. 


Show that the series converges absolutely. 


n 1 sinn 
(a) YE) meen? (b) 2552 


(c) 560; = (d) D cos nO 


Show that the series converges. 


n ѕіппӨ cos nO 
(а) 5 у Ту” (= < 0 < oo) (by =; (0 Z 2kx, k = integer) 
Determine whether the series is absolutely convergent, СЕЕ convergent, ог 
divergent. 


bn 
(a) 25 n (bam = b4m+1 = 1, bam42 = Бат+з = —1) 


(b) E > sin" (c) У оов" 


1234:52-:(2 1 
4-6-8---(2n+ 4) 
Let g be a rational function (ratio of two polynomials). Show that У g(n)r” con- 
verges absolutely if |r| « 1 or diverges if |r| > 1. Discuss the possibilities for 
Ir| = 1. 
Prove: If 3 a2 < oo and УЬ? < оо, then > | a,b, converges absolutely. 


(a) Prove: If X` a, converges and 35 a? = оо, then Уа» converges condition- 
ally. 
b) Give an example of a series with the properties described in (a). 
p prop 


Suppose that 0 < an+1ı < аһ and 


bp bo +--+ +b, 
Пав 


n—oo Wn 


where {w} is a sequence of positive numbers such that 


X. Un(dn — dn41) = oo 


Show that Y a4 b, = oo. HINT: Use summation by parts. 
(a) Prove: If 0 < 2e < 0 < x — 2e, then 


| sin 0| + |sin20| +---+ | sinn6| . sine 

Peer n x Iu 
HINT: Show that | sinn0| > sine at least “half the time"; more precisely, 
show that if | sin m0| < sine for some integer m then | sin(m + 1)0| > sine. 


33. 


34. 


35. 


36. 


37. 


38. 


39. 


40. 
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(b) Show that 
sinn 
A 
converges conditionally if 0 < p < 1 and 0 = Кл (К = integer). HINT: Use 
Exercise 4.3.3] and see Example 4.3.22. 


Show that 
jn AE (- Dii 1 a 
= 24 ux 
Let b3m+1, b3m42 = —2, and bag 43 = 1 form > 0. Show that 


Me 


2 1 
=з 2.7 (m + 1)(3т + 10) (3m + 2)’ 


n=1 


ll 


Let $` bn be obtained by rearranging finitely many terms of a convergent series 
>> an. Show that the two series have the same sum. 


Prove Theorem 4.3.26 for the case where (a) и is finite and v = oo; (b) u = —оо 
and v = oo; (c) и = v = œ. 


Give necessary and sufficient conditions for a divergent series to have a convergent 
rearrangement. 


A series diverges unconditionally to œ if every rearrangement of the series diverges 
to oo. State necessary and sufficient conditions for a series to have this property. 


Suppose that f and g have derivatives of all orders at 0, and let h = fg. Show 
formally that 


SN f™(0) g” (0) Һе? (0) , 
рива 


п=0 


in the sense of the Cauchy product. HINT: See Exercise 2.3.12. 


Prove: If ^ |an| < oo and Y, b, converges (perhaps conditionally), with У o dn = 
A and У, Р, = B, then the Cauchy product 


iE) 


converges to AB. HINT: Let {An}, {Bn}, and {Cy} be the partial sums of the series. 
Show that 


= А,В = У ав. =B 


and apply Theorem 4.3.5 to У |a; |. 
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41. Suppose that a, > 0 for all r > 0 and and Уу a, = A < оо. Show that 


1 n—1 1 n—1 
im = у, акъ = 0 and jim, m" у, а-у = 2А—ав. 
r,s=0 r,s=0 
42. Prove: If іт; оо ae =a; (j > 1) and ia X о; (i, j = 1), where y» 0j < 


оо, then lim;—>oo У у d = ep. 


43. Prove: If a, > 0, n > 1, and У) а, = оо, then У) а, /(1 + аһ) = оо. 
4.4 SEQUENCES AND SERIES OF FUNCTIONS 


Until now we have considered sequences and series of constants. Now we turn our attention 
to sequences and series of real-valued functions defined on subsets of the reals. Throughout 
this section, “subset” means “nonempty subset." 


If Fk, Fk+1, ..., Fu... are real-valued functions defined on a subset D of the reals, 
we say that { Р, } is an infinite sequence or (simply a sequence) of functions on D. If the 
sequence of values { F, (x)) converges for each x in some subset S of D, then ( F,} defines 
a limit function on S. The formal definition is as follows. 


Definition 4.4.1 Suppose that ( F,,} is a sequence of functions on D and the sequence 
of values { F4(x)) converges for each x in some subset S of D. Then we say that {Fn} 
converges pointwise on S to the limit function F , defined by 


F(x) = lim Р(х), xes. 


Example 4.4.1 The functions 


nx \"/? 
ro) = (17 1) | nel, 


define a sequence on D — (—oo, 1], and 


oo, x «0, 
lim (х) 241, x20, 
ш 0, 0<х<1. 


Therefore, { F,} converges pointwise оп 5 = [0, 1] to the limit function F defined by 


1, x=0, 
Fœ) = 10, o<x <1. 
Example 4.4.2 Consider the functions 

Fyx(x)=x"e"™, x-0, nl, 


(Figure 4.4.1). 
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yce 
y =F, x)ox"e 
> x 
Figure 4.4.1 
Equating the derivative 
Fi (x) = nx" 1е "(1 — x) 
to zero shows that the maximum value of F,(x) on [0, оо) is e^", attained at x = 1. 


Therefore, 
|Fn(x)| se, x > 0, 


so Пт, зоо Fn (x) = О for all x > 0. The limit function in this case is identically zero on 
[0, оо). 


Example 4.4.3 Forn > 1, let F, be defined on (—оо, оо) by 


0, x «—2, 

—n( + nx), —2 <x< -1, 
Е, (х) = 4n?x, -i <x<ł, 

n(2—nx), 2<x<2, 

0, x > 2 


(Figure 4.4.2, page 236), 


Since F,(0) = 0 for all n, іт, оо Fn (0) = 0. If x Æ 0, then Р, (х) = O ifn > 2/|x|. 
Therefore, 
lim F,(x) 20, —00 <x «oo, 
n—oo 


so the limit function is identically zero on (—oo, оо). 


Example 4.4.4 For each positive integer n, let S, be the set of numbers of the form 
x = p/q, where p and q are integers with no common factors and 1 < q < n. Define 


1, хє 6, 


Р(х) = 0 х65,. 
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If x is irrational, then x Z S, for any n, so F,(x) = 0,n > 1. If x is rational, then x € S, 
and F,(x) — 1 for all sufficiently large n. Therefore, 


if x is rational, 


| 1 
ШЫП, К) = F(x) = О if x is irrational. 


Figure 4.4.2 


Uniform Convergence 


The pointwise limit of a sequence of functions may differ radically from the functions in 
the sequence. In Example 4.4.1, each Ё, is continuous on (—оо, 1], but F is not. In 
Example 4.4.3, the graph of each F, has two triangular spikes with heights that tend to 
oo as п — co, while the graph of F (the x-axis) has none. In Example 4.4.4, each Р, 
is integrable, while F is nonintegrable on every finite interval. (Exercise 4.4.3). There is 
nothing in Definition 4.4.1 to preclude these apparent anomalies; although the definition 
implies that for each xo in S, Fa (хо) approximates F(xo) if n is sufficiently large, it 
does not imply that any particular Ё, approximates F well over all of S. To formulate а 
definition that does, it is convenient to introduce the notation 


[#15 = sup |g(x)| 
xeS 
and to state the following lemma. We leave the proof to you (Exercise 4.4.4). 


Lemma 4.4.2 If g and h are defined on S, then 


lg + Als < 118115 + llls 
and 


[#8 < llelislihlis. 


Moroever, if either g or h is bounded on S, then 


lg = А15 > 115 = 11511. 
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Definition 4.4.3 A sequence { Р, } of functions defined on a set S converges uniformly 
to the limit function F on S if 


lim |А — F||s = 0. 
п->со 
Thus, (F4) converges uniformly to F on S if for each є > 0 there is an integer № such that 


Fn = Е|5 <є if n>N. (4.4.1) 
E 


If S = [a, b] and F is the function with graph shown in Figure 4.4.3, then (4.4.1) implies 
that the graph of 


lies in the shaded band 


Е(х)-є<у< Е(х) +є, ax<x<b, 


їп > N. 
From Definition 4.4.3, if ( Р, } converges uniformly on S, then { Р, } converges uniformly 
on any subset of S (Exercise 4.4.6). 


y=F (x) +e 


y=F(x) 
y=F (x) -e 


> х 


| 
| 
| 
а Ь 


Figure 4.4.3 


Example 4.4.5 The sequence { Е, defined by 
Fi(x)=x"e™, pn], 


converges uniformly to F = 0 (that is, to the identically zero function) on 5 = [0, оо), 
since we saw in Example 4.4.2 that 


[Fn — Flis = 1515 =e”, 
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so 
[Fn — Flls <€ 
ifn > — loge. For these values of n, the graph of 
у = Ё„(х)) 0<х<оо, 


lies in the strip 
—exy<e, xz0 


(Figure 4.4.4). E 


The next theorem provides alternative definitions of pointwise and uniform convergence. 
It follows immediately from Definitions 4.4.1 and 4.4.3. 


Theorem 4.4.4 Let { F,) be defined on S. Then 


(a) (Fa) converges pointwise to F оп S if and only if there is, for each є > 0 and x € S, 
an integer N (which may depend on x as well as €) such that 


|К„(х)— F(x) «e if n>N. 


(b) {Fa} converges uniformly to F on S if and only if there is for each e > 0 an integer 
N (which depends only on € and not on any particular x in S) such that 


|Fn(x) — Е(х)| «e forall x in S ifn > N. 


—nx 


y =x"e 


Figure 4.4.4 


The next theorem follows immediately from Theorem 4.4.4 and Example 4.4.6. 
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Theorem 4.4.5 /f{F,} converges uniformly to F on S, then { Fa} converges pointwise 
to F on S. The converse is false; that is, pointwise convergence does not imply uniform 
convergence. 


Example 4.4.6 The sequence {Fp} of Example 4.4.3 converges pointwise to F = 0 
on (—oo, oo), but not uniformly, since 


1 
IF. - Flew = Fa (=) = 


50 
lim || Fn m F || (00,00) = oo. 
n—oo 


However, the convergence is uniform on 
Sp = (~œ, p] U [p, оо) 


for any p > 0, since 


. 2 
12. — Fls, =0 if n>-. 
p 


Example 4.4.7 If F,(x) = x", n > 1, then ( F,) converges pointwise on 5 = [0, 1] 
to 
L- xe 


F(x) = 0, 0< х =<1. 


The convergence is not uniform оп S. То see this, suppose that 0 < є < 1. Then 
|Е„(х)— 50) 1-е if П-ке, 


Therefore, 
1—e < ||Fa -Fls <1 


for all n > 1. Since e can be arbitrarily small, it follows that 
|Fn — Fls = 1 


for all n > 1. 


However, the convergence is uniform on [0, p] if 0 « o < 1, since then 
|| Fn = F |lto.o] = 0" 


and іт, оо o" = 0. Another way to say the same thing: (F5) converges uniformly on 
every closed subset of [0, 1). ш 


The next theorem enables us to test a sequence for uniform convergence without guessing 
what the limit function might be. It is analogous to Cauchy’s convergence criterion for 
sequences of constants (Theorem 4.1.13). 
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Theorem 4.4.6 (Cauchy’s Uniform Convergence Criterion) A sequence 
of functions ( F4] converges uniformly оп a set S if and only if for each є > 0 there is an 
integer N such that 

|Fn — „15 <€ if nimz М. (4.4.2) 


Proof For necessity, suppose that { F,,} converges uniformly to F on S. Then, if € > 0, 
there is an integer N such that 


IF: - Fls <5 if k>N. 


Therefore, 


2, = Falls = | (Fn = F) + (F — Fin) lls 
< || Fn — Fils + || F — Falls (Lemma 4.4.2) 


< 5+5=6 if т,п> N. 


For sufficiency, we first observe that (4.4.2) implies that 
|Fí(x) – Ёһ(х)| «e if п,т> М, 


for any fixed x in S. Therefore, Cauchy's convergence criterion for sequences of constants 
(Theorem 4.1.13) implies that ( Р, (х)} converges for each x in S; that is, ( Fn} converges 
pointwise to a limit function F on S. To see that the convergence is uniform, we write 


| Fm (x) — F(x)| = ПЕ (0) — Fn()] + Fr (x) — F(x)]l 
€ | Fin(x) — Р(х) + |Ё„(х) — F(x)| 
< || Fm — Falls +120) — F(x)]. 


This and (4.4.2) imply that 
|Fm (x) — F(x)| < € + |Ё„(х)— F(x)) if п,т> М. (4.4.3) 
Since limy—+oo Fn (x) = F(x), 
| Fn(x) – F(x)| < є 
for some n > N, so (4.4.3) implies that 
|Fin(x) - Е(х)| «2e if т> М. 
But this inequality holds for all x in S, so 
|Fm— Fls < 26 if т> М. 


Since e is an arbitrary positive number, this implies that ( Е, } converges uniformly to F 
on S. ш 


The next example is similar to Example 4.1.14. 
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Example 4.4.8 Suppose that g is differentiable on 5 = (—оо, оо) and 
le'x)) £r «1, —oo«x «oo. (4.4.4) 
Let Fo be bounded on S and define 
Fy (х) = g(Fn-i(x)), п>1. (4.4.5) 


We will show that { F;,} converges uniformly on S. We first note that if u and v are any two 
real numbers, then (4.4.4) and the mean value theorem imply that 


|e) — g(v)| < r|u — v]. (44.6) 
Recalling (4.4.5) and applying this inequality with u = £F, (x) and v = 0 shows that 


|Fn(x)| = 1400) + (gCFn-1(x)) — 8(0))| < 1g(0)] + |#(®»—1()) — 80) 
< |g(0)| + r| Fi Q9): 


therefore, since Fo is bounded on 5, it follows by induction that Р, is bounded on S for 
n > 1. Moreover, if n > 1, then (4.4.5) and (4.4.6) with u = Р(х) and v = Fy_-1(x) 
imply that 


[Кп+1(х)— Ё„(х)| = |40 Q0) – 86-109) < г|Ёһ(х)— Fnr- Œ), оо < x < оо, 


SO 
| Fnti — Falls € rl Fn = Frills. 


By induction, this implies that 
Аъ — Falls < r^] F1 — Folls. (4.4.7) 
If n > т, then 


|| Fn = Falls = | Fn = Fn-1) + (В = Fn-2) + -++ + (Fm+1 = Fus 
= | Fn = Fn-ills + | Fn—1 = Fr—-alls ++: + | Fm+1— Fnlls. 


from Lemma 4.4.2. Now (4.4.7) implies that 


[tr Falls < i= Follis Q +r +r? eo pre" 
m 


Е 
< |5 = Fols : 
l-r 
Therefore, if 


rN 
| F1 — Folls 


< є, 
l-r 


then | Fn — Fn|ls < € if n, m > N. Therefore, {F,} converges uniformly on S, by 
Theorem 4.4.6. 
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Properties Preserved by Uniform Convergence 


We now study properties of the functions of a uniformly convergent sequence that are 
inherited by the limit function. We first consider continuity. 


Theorem 4.4.7 If (F4) converges uniformly to F on S and each F, is continuous at 
a point xo in S, then so is F. Similar statements hold for continuity from the right and left. 


Proof Suppose that each Р, is continuous at xo. If x € S and n > 1, then 


|F(x) — F(xo)l < |F(x) — Р. (х) + | Fn(x) — Fnr (хо) + | Fn(xo) — F(xo) 


< | Fa (x) — Е,(хо) + 2I Fs — Fils. (4.4.8) 


Suppose that є > 0. Since { Ё»} converges uniformly to F on S, we can choose n so that 
l| F, — F|[s < є. For this fixed n, (4.4.8) implies that 


|F(x) — F(xo)| < |Е„(х) — Fn(xo)| +2€, x € S. (4.4.9) 
Since F, is continuous at хо, there is a ё > 0 such that 
|Fn(x) — Fu(xo)| «€ if |x —xo| < 6, 


so, from (4.4.9), 
|F(x) — F(xo)| «3e, if |x —xg| < ô. 


Therefore, F is continuous at хо. Similar arguments apply to the assertions on continuity 
from the right and left. ш 


Corollary 4.4.8 If (F4) converges uniformly to F on S and each F, is continuous on 
S, then so is Е; that is, a uniform limit of continuous functions is continuous. 


Now we consider the question of integrability of the uniform limit of integrable func- 
tions. 


Theorem 4.4.9 Suppose that ( F4) converges uniformly to F on S = [a,b]. Assume 
that F and all F, are integrable on |a, b]. Then 


b b 
| F(x)dx = lim f F(x) dx. (4.4.10) 
Proof Since 


b b b 
| Бб)ах- | Е(х) ах = | |Fn(x) — F(x)| dx 


< (b — a)|F» — Flls 


and limy—+o0 || Fn — F||s = 0, the conclusion follows. E 
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In particular, this theorem implies that (4.4.10) holds if each F, is continuous on [a, b], 
because then F is continuous (Corollary 4.4.8) and therefore integrable on [a, b]. 

The hypotheses of Theorem 4.4.9 are stronger than necessary. We state the next theorem 
so that you will be better informed on this subject. We omit the proof, which is inaccessible 
if you skipped Section 3.5, and quite involved in any case. 


Theorem 4.4.10 Suppose that ( F4) converges pointwise to F and each F, is inte- 
grable on |a, b]. 
(a) Ifthe convergence is uniform, then F is integrable on [a, b] and (4.4.10) holds. 


b) Uf the sequence {|| Е„һ||\та pı} is bounded апа F is integrable on [a, b], then (4.4.10) 
q [a,b] 8 
holds. 


Part (a) of this theorem shows that it is not necessary to assume in Theorem 4.4.9 that F 
is integrable on [a, 5], since this follows from the uniform convergence. Part (b) is known 
as the bounded convergence theorem. Neither of the assumptions of (b) can be omitted. 
Thus, in Example 4.4.3, where (|| Fn ||[o,1] is unbounded while F is integrable on [0, 1], 


1 1 
| Fua(x)dx =1, п> 1, but | F(x)dx = 0. 
0 0 


In Example 4.4.4, where || Fy ||[a,p) = 1 for every finite interval [a, b], Fn is integrable for 
all n > 1, and F is nonintegrable on every interval (Exercise 4.4.3). 


After Theorems 4.4.7 and 4.4.9, it may seem reasonable to expect that if a sequence {Fn} 
of differentiable functions converges uniformly to F on S, then F’ = lim; »оо F, on S. 
The next example shows that this is not true in general. 


Example 4.4.9 The sequence ( F;) defined by 


Е, (х) = x" sin 


xn-1 


converges uniformly to F = 0 on [ri, r2] if 0 < rı < ra < 1 (or, equivalently, on every 
compact subset of (0, 1)). However, 


Е! (x) = nx"! sin — (n — 1) cos 


xn-1 xn-l? 


so { F; (x)} does not converge for any x in (0, 1). 
Theorem 4.4.11 Suppose that F} is continuous оп [a,b] for all n > 1 and {F}} 


converges uniformly on |a, b]. Suppose also that ( Fa (xo)} converges for some xo in |a, b]. 
Then ( F4] converges uniformly on [a, b] to a differentiable limit function F, and 


F'(x) = Jim Fi(x), a<x<b, (4.4.11) 


while 
Е; (а) = lim Fj} (a+) and F'(b)- lim F,(b—). (4.4.12) 
поо п-*00 
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Proof Since F/ is continuous on [a, b], we can write 


Fy(x) = Fy(xo) + f Е;(1) 41, a<x<b (4.4.13) 


хо 
(Theorem 3.3.12). Now let 
L = lim Р, (хо) 
n—oo 
and 


G(x) = lim Р, (х). (4.4.14) 


Since Ру is continuous and (F,) converges uniformly to С on [а,Ь], С is continuous on 
la, b] (Corollary 4.4.8); therefore, (4.4.13) and Theorem 4.4.9 (with F and Р, replaced by 
G and F’) imply that ( Ё„} converges pointwise оп [a, b] to the limit function 


F(x) = 1+ L G(t) dt. (4.4.15) 
хо 


The convergence is actually uniform on [a,b], since subtracting (4.4.13) from (4.4.15) 
yields 


|F(x) — Fn(x)| < |L — Fa(xo)| + 


| \б@)— FL) dt 
хо 
<|L — FE + Ix — xol |G — Fl 


SO 
|F = Ел |а < |1, -— Ел (хо) * (b — а)||С = F; |lla,b]; 
where the right side approaches zero as n — oo. 


Since G is continuous on [a, b], (4.4.14), (4.4.15), Definition 2.3.6, and Theorem 3.3.11 
imply (4.4.11) and (4.4.12). ш 


Infinite Series of Functions 


In Section 4.3 we defined the sum of an infinite series of constants as the limit of the 
sequence of partial sums. The same definition can be applied to series of functions, as 
follows. 


Definition 4.4.12 If { fj}? is a sequence of real-valued functions defined on a set D 


of reals, then Ya fj is an infinite series (or simply a series) of functions on D. The 
partial sums оў, УУ. f; are defined by 


n 
= Ул ме. 
j=k 


If {2,390 converges pointwise to a function F on a subset 5 of D, we say that рар? Л) 
converges pointwise to the sum F оп S, and write 


F=) fj xes. 
i=k 
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If {Fa} converges uniformly to F on S, we say that b» fj converges uniformly to F 
on S. 


Example 4.4.10 The functions 
Бб) = х/, ј 20, 

define the infinite series 

oo 

D 

j-0 
on D = (—oo, оо). The nth partial sum of the series is 

Е„(х) = 1-р 4E 


or, in closed form, 


t= х1 


—_, 1, 
Bid gag Oe 
n+1, x=1 


(Example 4.1.11). We have seen earlier that { Е, } converges pointwise to 
1 
F(x) = w— 
1-х 
if |x| < 1 and diverges if |x| > 1; hence, we write 


oo 
; 1 

A = , -l«xc«l. 

ram 1—x 


Since the difference 


xttl 


i= 
can be made arbitrarily large by taking x close to 1, 


F(x) — Fr(x) = 


[К — Frll(iay = оо, 
so the convergence is not uniform on (—1, 1). Neither is it uniform on any interval (—1, r] 
with —1 <r « 1, since 

1 

|F — Р, ||(=1,) = 2 
for every n on every such interval. (Why?) The series does converge uniformly on any 
interval [-r, r] with 0 « r « 1, since 
phi 
l-r 


and limy—+oo r” = 0. Put another way, the series converges uniformly on closed subsets of 
(—1,1). ш 


Е z Ел ||[—тг] = 
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As for series of constants, the convergence, pointwise or uniform, of a series of functions 
is not changed by altering or omitting finitely many terms. This justifies adopting the 
convention that we used for series of constants: when we are interested only in whether a 
series of functions converges, and not in its sum, we will omit the limits on the summation 
sign and write simply У fn. 


Tests for Uniform Convergence of Series 


Theorem 4.4.6 is easily converted to a theorem on uniform convergence of series, as fol- 
lows. 


Theorem 4.4.13 (Cauchy’s Uniform Convergence Criterion) A series 
У fn converges uniformly on a set S if and only if for each є > 0 there is an integer N 
such that 


ll fn + fna cot 515 < € if т>п> М. (44.16) 


Proof Apply Theorem 4.4.6 to the partial sums of У fn, observing that 


Љ + fata tees fm = Fin — Fia. 


Setting m = n in (4.4.16) yields the following necessary, but not sufficient, condition 
for uniform convergence of series. It is analogous to Corollary 4.3.6. 


Corollary 4.4.14 If Y^ f, converges uniformly on S, then litn—co || falls = 0. 


Theorem 4.4.13 leads immediately to the following important test for uniform conver- 
gence of series. 


Theorem 4.4.15 (Weierstrass's Test) The series У fn converges uniformly 
on S if 
1515 < Mn, п> К, (4.4.17) 


where УУМ, < oo. 
Proof From Cauchy’s convergence criterion for series of constants, there is for each 
є > Oan integer N such that 
Mn + М ++ Mm <e if mnzN, 
which, because of (4.4.17), implies that 


lalis + 1:15 fms <e if m,n>N. 
Lemma 4.4.2 and Theorem 4.4.13 imply that У fn converges uniformly on S. ш 
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Example 4.4.11 Taking M, = 1/n? and recalling that 


we see that 


converge uniformly on (—oo, оо). 


Example 4.4.12 The series 


Уло (12) 


converges uniformly on any set S such that 


<r<l, xes, (4.4.18) 


= 


because if S is such a set, then 
| falls <r” 


and Weierstrass’s test applies, with 


Уу M=} "<o. 


Since (4.4.18) is equivalent to 


—r r 
—— <y < 
l+r7 ^ l-r 


this means that the series converges uniformly on any compact subset of (—1/2, 00). 
(Why?) From Corollary 4.4.14, the series does not converge uniformly on S = (—1/2, b) 
with b < co or on S = [a, оо) witha > —1/2, because in these cases || /||s = 1 for all 
n. a 


Weierstrass’s test is very important, but applicable only to series that actually exhibit a 
stronger kind of convergence than we have considered so far. We say that У) fn converges 
absolutely on S if У |}, | converges pointwise on S, and absolutely uniformly on S if 
X | fn| converges uniformly on S. We leave it to you (Exercise 4.4.21) to verify that our 
proof of Weierstrass's test actually shows that У f, converges absolutely uniformly on S. 
We also leave it to you to show that if a series converges absolutely uniformly on S, then it 
converges uniformly on S (Exercise 4.4.20). 


The next theorem applies to series that converge uniformly, but perhaps not absolutely 
uniformly, on a set S. 
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Theorem 4.4.16 (Dirichlet’s Test for Uniform Convergence) The se- 


ries 
oo 
2 Ља 
n=k 


converges uniformly on S if { fa} converges uniformly to zero on S, Y (+1 — fa) con- 
verges absolutely uniformly on S, and 


[#к + gei t gus S M, п> К, (4.4.19) 
for some constant M. 
Proof The proof is similar to the proof of Theorem 4.3.20. Let 

Gn = gk + 8k+1 b o En, 

and consider the partial sums of 37-4. fngn: 

Hn = fkgk + fe+i8kt+i o /п8п. (4.4.20) 
By substituting 

ёк = бк and gn = С, —Ga-ji, nzk-l, 
into (4.4.20), we obtain 
An = fkGk + (Сан — Gk) ++ fa (Gn — Gn-1). 
which we rewrite as 
Н, = (fk — fici) Gk + (Seti ао) бкн ++ (Ља — fn)Gn-1 + fnGn, 


or 
An = Jn-1 + fnGn, (4.4.21) 


where 


Jn-1 = (Jfk — fk413)Gk + Cfi — Јо) Ск ++ Cfi — fn)Gn-1. (4.4.22) 


That 15, {Jn } is the sequence of partial sums of the series 
oo 
YG - FG). (4.4.23) 
=e 


From (4.4.19) and the definition of G j, 


YLO- fjai0918;6)| <M DVI) — fu), x € S. 


j=n j=n 


Section 4.4 Sequences and Series of Functions 249 


50 


YG- fj406;| SM IM lA - Fal 
j=n j=n 


S S 


Now suppose that e > 0. Since (f; — fj+1) converges absolutely uniformly оп S, The- 
orem 4.4.13 implies that there is an integer N such that the right side of the last inequality 
is less than e if m > n > N. The same is then true of the left side, so Theorem 4.4.13 
implies that (4.4.23) converges uniformly on S. 


We have now shown that {J;,} as defined in (4.4.22) converges uniformly to a limit 
function J on S. Returning to (4.4.21), we see that 


Hg = J = Jn — J  fnGn. 
Hence, from Lemma 4.4.2 and (4.4.19), 


| Hs — Jlis = 17-1 = Js + 151516115 
< 15-1 = Jlis + MI falls. 


Since (J4.1 —J ) and { fn } converge uniformly to zero on S, it now follows that lim, soo |Н, — 
J ||s = 0. Therefore, { Н„} converges uniformly on S. a 


Corollary 4.4.17 The series У), fn&n converges uniformly on S if 


Jnti(x) € fax), x ES, nzk, 


{fn} converges uniformly to zero on S, and 


lgk + Seti c „15 <M, п> К, 


for some constant M. 


The proof is similar to that of Corollary 4.3.21. We leave it to you (Exercise 4.4.22). 


Example 4.4.13 Consider the series 


oo . 
У) Sinnx 
n 


n=1 


with f, = 1/n (constant), g,(x) = sinnx, and 
Gy(x) = sinx + sin2x +--+- + sinnx. 


We saw in Example 4.3.21 that 


1 
|Gn(x)| = [sin@e/2)|’ п>], n Æ 2кл (k = integer). 
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Therefore, {||Gn||s} is bounded, and the series converges uniformly on any set 5 on which 
sin x/2 is bounded away from zero. For example, if 0 < 6 < л, then 


AES. . 6 
sin 5 | > sin- 
2 2 


if x is at least 6 away from any multiple of 27; hence, the series converges uniformly on 


S= |] Bkr +8,2(k + Dn — ô]. 


k=—0o 


Е 


(Exercise 4.3.32(b)), this result cannot be obtained from Weierstrass’s test. 


Since . 
sinnx 


= оо, х#Кл 


Example 4.4.14 The series 


Y (un 
2 
r +x 
satisfies the hypotheses of Corollary 4.4.17 on (—oo, оо), with 


ЛО) = $n = (-1)", Gam = 0, and Gom+1 = —1. 


n+x2’ 


Therefore, the series converges uniformly on (—оо, оо). This result cannot be obtained by 
Weierstrass's test, since 
1 
кз n+ x2 m 


for all x. 


Continuity, Differentiability, and Integrability of Series 


We can obtain results on the continuity, differentiability, and integrability of infinite series 
by applying Theorems 4.4.7, 4.4.9, and 4.4.11 to their partial sums. We will state the 
theorems and give some examples, leaving the proofs to you. 


Theorem 4.4.7 implies the following theorem (Exercise 4.4.23). 


Theorem 4.4.18 ЈУ, fn converges uniformly to F on S and each fy is contin- 
uous at a point xo in S, then so is F. Similar statements hold for continuity from the right 
and left. 


Example 4.4.15 In Example 4.4.12 we saw that the series 


мәте) 


n=0 
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converges uniformly on every compact subset of (—1/2, 00). Since the terms of the series 
are continuous on every such subset, Theorem 4.4.4 implies that F is also. In fact, we can 
state a stronger result: F is continuous on (—1/2, со), since every point in (—1/2, oo) lies 
in a compact subinterval of (—1/2, оо). 
The same argument and the results of Example 4.4.13 show that the function 
eo. sinnx 
G(x) = 
(ey Hn 


n=1 


is continuous except perhaps at x, = 2Ёл (К = integer). 
From Example 4.4.14, the function 
1 


n+ x? 


oo 
H(x) = ) D" 
n=1 
is continuous for all x. ш 


The next theorem gives conditions that permit the interchange of summation and inte- 
gration of infinite series. It follows from Theorem 4.4.9 (Exercise 4.4.25). We leave it to 
you to formulate an analog of Theorem 4.4.10 for series (Exercise 4.4.26). 


Theorem 4.4.19 Suppose that $7} fn converges uniformly to F on S = [a,b]. 
Assume that F and fn, n > k, are integrable on |a, b]. Then 


b oo b 
/ F(x) dx =] fa (X) dx. 


We say in this case that У 20, f, can be integrated term by term over [a, b]. 


Example 4.4.16 From Example 4.4.10, 


1 oo 
=> x", -l<x<l. 
1—x = 


The series converges uniformly, and the limit function is integrable оп any closed subinter- 


val [a, b] of (—1, 1); hence, 
b d oo b 
f н Уу], x" dx, 
a 1—Х 20 Ја 


оо 
pn = qnt 


log(1 — a) —log(1 — b) = у, 


50 


n+1 
Letting a = 0 and b = x yields 


oo п+1 


log(1 — x) 2 — У; id 


n= 
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The next theorem gives conditions that permit the interchange of summation and differ- 
entiation of infinite series. It follows from Theorem 4.4.11 (Exercise 4.4.28). 


Theorem 4.4.20 Suppose that f, is continuously differentiable on [a, b] for each n > 
k, Уос /n(xo) converges for some xo in [a,b], and Y7 y f, converges uniformly on 
[a,b]. Then У, fn converges uniformly on [а, b] to a differentiable function F, and 


F'(x) — У dq. a<x<hb, 
=k 


while 


Fat) => fiat) and F'(b-)— M fi(b-). 


n=k n=k 
We say in this case that У 22, fn can be differentiated term by term on [а,Ь]. To apply 
Theorem 4.4.20, we first verify that У 99, fn(xo) converges for some хо in [а, b] and then 
differentiate 37^ , f, term by term. If the resulting series converges uniformly, then term 


by term differentiation was legitimate. 


Example 4.4.17 The series 
= 1 x 
У. (-1)*- cos — (4.4.24) 
= п п 
converges at хо = 0. Differentiating term by term yields the series 
= 1 х 
Sons sin- (4.4.25) 
= n n 


of continuous functions. This series converges uniformly on (—оо, oo), by Weierstrass's 
test. By Theorem 4.4.20, the series (4.4.24) converges uniformly on every finite interval to 
the differentiable function 


oo 
1 

F(x) = 31 C1 сов =, —oo«x «oo, 

= п п 
апа 

оо 1 x 

Е'(х) = У (-1)"t!— sinc, -oo«x «oo. 

(x) 2 ) im co < x «oo 


Example 4.4.18 The series 


oo x^ x2 x3 
B(xyes у = le ty spes (4.4.26) 


n=0 


Section 4.4 Sequences and Series of Functions 253 


converges uniformly on every interval [—r, г] by Weierstrass’s test, because 


and 


for all r, by the ratio test. Differentiating the right side of (4.4.26) term by term yields the 
series 


which is the same as (4.4.26). Therefore, the differentiated series is also uniformly conver- 
gent on [—r, r] for every r, so the term by term differentiation is legitimate and 


E'(x) = E(x), —oo«x «oo. 
This is not surprising if you recognize that E(x) = e". 


Example 4.4.19 Failure to verify that the given series converges at some point can 
lead to erroneous conclusions. For example, differentiating 


ы x 
У cos- (4.4.27) 
n 
n=1 
term by term yields 
oo 
lx 
— у, — sin —, 
гүп п 
which converges uniformly on [—r, г] for every r, since 


< al (Exercise 2.3.19) 


sz if |x| <r, 


and Y^ 1/n? < oo. We cannot conclude from this that (4.4.27) converges uniformly on 
[—r, r]. In fact, it diverges for every x. (Why?) 


4.4 Exercises 


1. Find the set S on which ( F, } converges pointwise, and find the limit function. 
(a) Е„(х) = x"(1— x?) (b) F,(x) = nx" (1 — x?) 
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11. 


12. 


(с) Б) =х"@—х”) (d) кб) = sin (1 i JL 
(е) Fn) = LL (f) FG) = sin? 

(в) 0) =n? (1—cos =) (h) Fy (x) = nxe"? 
= etm 


Prove: If ( F4] converges to F on [а,Ь] and Fn is nondecreasing for each n, then F 
is nondecreasing. 


Show that the functions { F,) of Example 4.4.4 are integrable and F = іт, oo Fn (х) 
is nonintegrable on every finite interval. 


Prove Lemma 4.4.2. 

Find F(x) = limyp—+oo F,(x) on S. Show that { Ё„} converges uniformly to F on 
closed subsets of S, but not on S. 

(а) Fa(x) = x” sinnx, S = (-1,1) 


1 
(Ъ) mogeil e 5 ={x|x #1; 
n? sinx 

c) F, = —— 

( ) n(x) 1 + п2х? 

(a) Show that if ( Е, } converges uniformly on S, then {Fp} converges uniformly 
on every subset of S. 

(b) Show that if {Fp} converges uniformly on $1, S5, ..., Sm, then {Fp} con- 
verges uniformly on  J7.., Sx. 


S = (0, co) HINT: See Exercise 2.3.19. 


(c) Give an example where { F,,} converges uniformly on each of an infinite se- 
quence of sets S1, $5, ..., but not on rm Sx. 

Describe the sets on which the sequences of Exercise 4.4.1 converge uniformly. Re- 
strict your attention to sets that are the union of finitely many intervals and singleton 
sets. 

Suppose that { Р, } converges pointwise on [a, b] and, for each x in [a, b], there is 
an open interval 7y containing x such that { Р, } converges uniformly on Zx N [a, b]. 
Show that ( Р, } converges uniformly on [a, b]. 


Prove: If ( F4) converges uniformly to F on S, then lim; sos || Falls = || Fs. 


Prove: If { Р, } converges uniformly to F on S, then F is bounded on S if and only 
if lim; soo {|| Fn ||} < оо. 

Prove: If {Fp} and {Gn} converge uniformly to F and С on S, then {Р + Gn} 
converges uniformly to F 4- G on S. 


(a) Prove: If {F,} and (G4) converge uniformly to bounded functions F and G 
on 5, then { Р, Gn} converges uniformly to FG on 5. 


13. 


14. 


15. 


16. 


17. 


18. 


19. 


20. 
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(b) Give an example showing that the conclusion of (a) may fail to hold if F or 
G is unbounded on S. 


(a) Suppose that ( Ё„} converges uniformly to F on (a, b). Prove: If xo <a <b 
and La = limy+x9 Fn(x) exists (finite) for every n, then L = Шш, »о Ln 
exists (finite) and 

lim F(x) = L. 
x—>xo 


(b) State similar results for limits from the right and left. 
Find the limits. 


4 
d 
(a) lim " sin = dx (b) lim EL 
n—oo m X n noo 0, 1 + x2" 
(c) lim nxe^"* dx (d) lim | (1 Е =)" dx 
noo Jo поо Jo n 


Prove (without using Theorem 4.4.10): If each Р, is integrable and { Р, } converges 
uniformly on [a, b], then іт, оо /? Е, (х) dx exists. 


Prove (without using Theorem 4.4.10): If each Р, is nondecreasing and { Ё, } con- 
verges uniformly to F on [a, b], then 


b b 
lim f Feds | F(x) dx. 


Use Weierstrass's test to determine sets on which the series converges absolutely 
uniformly. 


(Ys (Fe) ) Dae (as) 
(c) Enx" х) (d) >> —— 


(е) Y yy D aus 

n* (1 + x2) 

Show that if У |an| < oo, then 37a, cosnx and $a, sinnx define continuous 
functions on (—oo, оо). 


(a) Give an example showing that the following “comparison test" is invalid: If 
Y. fn converges uniformly on S and ||gn|ls < || falls. then У gn converges 
uniformly on S. 

(b) This “comparison test” can be corrected by adding one word to its hypothesis 
and conclusion. What is the word? 


(a) Explain the difference between the following statements: (i) У) /, converges 
absolutely and uniformly on S; (ii) Y; f, converges absolutely uniformly 
on S. 
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(b) Show that if Y^ f, converges absolutely uniformly on S, then У f, converges 
uniformly on S. 


21. Show that the hypotheses of Weierstrass's test imply that У /, converges absolutely 
uniformly on S. 


22. Prove Corollary 4.4.17. 
23. Prove Theorem 4.4.18. 


24. Suppose that {а}? is monotonic and іт», оо dn = 0. Show that 


oo oo 
у аһ ѕіппх and у аһ COSNX 
n=1 n=1 


define functions continuous for all x Æ 2kx (k = integer). 
25. Prove Theorem 4.4.19. 
26.  Formulate an analog of Theorem 4.4.10 for series. 
27. In Section 4.5 we will see that 


2n 2п+1 


2 = nx А = nx 
e E УС!) and sinx = УС!) 
п=0 п=0 


n! (2n + 1)! 
for all x, and in both cases the convergence is uniform on every finite interval. Find 
series that converge to 

x » as 

t 
(а) F(x)-2 | et dt and(b) G(x) = | Tdi 
0 0 
for all x. 
28. Prove Theorem 4.4.20. 


29. Show from Example 4.4.17 that У 20 (—1)" sin(x/n) converges uniformly on any 
finite interval. 


30. Prove: If 0. < аһ < аһ and Уа? < oo for some positive integer k, then 
35-1)" sina, x converges uniformly on any finite interval. 


31. Forn > 2, define 
n^(x — n + 1/n?), n—1/ne<x<n, 
РО) = 4-n*(x-n-1/n) n<x<n4+1/n3, 
0, |x ^ n| > 1/n3, 
and let F(x) = У, у, (х). Show that /0° F(x) dx < оо, and conclude that ab- 


solute convergence of an improper integral fi a. F(x) dx does not imply that іт, оо F(x) = 
0, even if F is continuous on [0, co). 
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4.5 POWER SERIES 


We now consider a class of series sufficiently general to be interesting, but sufficiently 
specialized to be easily understood. 


Definition 4.5.1 An infinite series of the form 
oo 
У `ап(х — хо)". (4.5.1) 
=0 


where хо and ao, a1, ..., are constants, is called а power series in х — xo. ш 


The following theorem summarizes the convergence properties of power series. 


Theorem 4.5.2 In connection with the power series (4.5.1), define R in the extended 
reals by 


1 — 
— = lim |a, |'/". (4.5.2) 
noo 


1/n 


In particular, R = 0 ії, оо |an|!/" = oo, and R = oo if lim, оо |an|!/" = 0. Then 


the power series converges 
(a) onlyfor x = xo if R = 0; 
(b) forall x if R — oo, and absolutely uniformly in every bounded set; 


(c) for x in (xo — R, xo + R) if0 < R < co, and absolutely uniformly in every closed 
subset of this interval. 


The series diverges if |x — хо| > R. No general statement can be made concerning conver- 
gence at the endpoints x = хо + Rand x = xo — R : the series may converge absolutely 
or conditionally at both, converge conditionally at one and diverge at the other, or diverge 
at both. 


Proof Inany case, the series (4.5.1) converges to ag if x — xo. If 
У laslr" < oo (4.5.3) 


for some r > 0, then $a, (x — xo)" converges absolutely uniformly in [xo — r, xo + 
r], by Weierstrass's test (Theorem 4.4.15) and Exercise 4.4.21. From Cauchy's root test 
(Theorem 4.3.17), (4.5.3) holds if 


Tim (|a, |r")!/" « 1, 
п->со 


which is equivalent to 
r lim J|a,|/" <1 
поо 


(Ехегсіѕе 4.1.30(а)). From (4.5.2), this can be rewritten as r < R, which proves the 
assertions concerning convergence in (b) and (c). 


If 0 < R < co and |x — xo| > R, then 
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1 1 

— > ———, 

R  |x—xo| 
so (4.5.2) implies that 


las |! /" > 


> and therefore |а, (х — хо)”| > 1 
|x — xol 


for infinitely many values of n. Therefore, > a, (x — xo)" diverges (Corollary 4.3.6) if 
|x — xo| > R. In particular, the series diverges for all x Æ xo if R = 0. 

To prove the assertions concerning the possibilities at x = хо + R and x = хо — R 
requires examples, which follow. (Also, see Exercise 4.5.1.) ш 

The number R defined by (4.5.2) is the radius of convergence of Ў`аһ(х — xo)". If 
R > 0, the open interval (xo — R, хо + R), or (—œ0, оо) if R = œ, is the interval of 
convergence of the series. Theorem 4.5.2 says that a power series with a nonzero radius 
of convergence converges absolutely uniformly in every compact subset of its interval of 
convergence and diverges at every point in the exterior of this interval. On this last we can 
make a stronger statement: Not only does » а, (x — xo)" diverge if |x — xo| > R, but the 
sequence {a(x — xo)" ) is unbounded in this case (Exercise 4.5.3(b)). 


Example 4.5.1 For the series 
sinnz/6 
M —» Y = 1)", 
we have 


: 1 
Tm ш" = Tm (LN 
noo ^| n—oo 2n 


1 = 
= = lim (|sinnz/6|)/" (Exercise 4.1.30(a)) 
2 n—oo 


1 1 


Therefore, R = 2 and Theorem 4.5.2 implies that the series converges absolutely uniformly 
in closed subintervals of (—1, 3) and diverges if x < —1 or x > 3. Theorem 4.5.2 does not 
tell us what happens when x = —1 or x = 3, but we can see that the series diverges in both 
these cases since its general term does not approach zero. 


Example 4.5.2 For the series 
x” 
22 
- EN GC MR 1 d 
lim |a,|!/" = lim Ө = lim exp (5 ох) =е0 = 1. 
Therefore, А = 1 and the series converges absolutely uniformly in closed subintervals 


of (—1, 1) and diverges if |x| > 1. For x = —1 the series becomes У`(— 1)" /п, which 
converges conditionally, and at x = 1 the series becomes У 1/n, which diverges. " 
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The next theorem provides an expression for R that, if applicable, is usually easier to use 
than (4.5.2). 


Theorem 4.5.3 The radius of convergence of Y, an(x — xo)" is given by 


an+1 
an 


if the limit exists in the extended reals. 


Proof From Theorem 4.5.2, it suffices to show that if 


= а (4.5.4) 
поо | аһ 
exists in the extended reals, then 
L= lim |a|”. (4.5.5) 
n—oo 


We will show that this is so if 0 « L « oo and leave the cases where L — 0 or L — oo to 
you (Exercise 4.5.7). 


If (4.5.4) holds with 0 < L « oo and 0 « є « L, there is an integer N such that 


am+1 


L—e« <L+e if т> М, 


ат 


so 
lam|(L — €) < |ат+1| < lam|(L +6) if т> М. 


By induction, 


ge 


lan|(L — € < las| < |ам\( + 6)" if n>N. 


Therefore, if 
Kı =|an|(L—e) % and Kz = |ам|(1 + 6)“, 


then 
KU os) sus Sk Ee) (4.5.6) 


Since lim, оо K!/" = 1 if K is any positive number, (4.5.6) implies that 


1/n 


1,—є < lim ase Tm us] ^t < bsp 
noo 


n—oo 
Since e is an arbitrary positive number, it follows that 
lim |а|" = L, 
поо 


which implies (4.5.5). E 
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Example 4.5.3 For the power series 


= lim —— 
n>on+] 


ап 
Therefore, R = oo; that is, the series converges for all x, and absolutely uniformly in every 
bounded set. 


Example 4.5.4 For the power series 


n 
yx К 


1)! 
an noo n! n—oo 


Therefore, R = 0, and the series converges only if x = 0. 


Example 4.5.5 Theorem 4.5.3 does not apply directly to 


у, (= x?" (p = constant) (4.5.7) 
4"gP , ~ 
which has infinitely many zero coefficients (of odd powers of x). However, by setting 
y = х2, we obtain the series 


=l n 
x ) у", (4.5.8) 


4"gP 


which has nonzero coefficients for which 


an+1 
an 


lim 


n—oo 


н 4" nP 1 н 1+ 1\? | 
= hm ——— ——— = — пш же = >. 
n—oo 4n (n 41) Д n—oo n 4 


Therefore, (4.5.8) converges if |y| < 4 and diverges if |y| > 4. Setting y = x?, we 
conclude that (4.5.7) converges if |x| « 2 and diverges if |x| > 2. At x = +2, (4.5.7) 
becomes 37 (—1)" /n? , which diverges if p < 0, converges conditionally if 0 < p < 1, and 
converges absolutely if p > 1. 


Properties of Functions Defined by Power Series 


We now study the properties of functions defined by power series. Henceforth, we consider 
only power series with nonzero radii of convergence. 


Theorem 4.5.4 A power series 


f(x) = Max – xo)" 
n=0 
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with positive radius of convergence R is continuous and differentiable in its interval of 
convergence, and its derivative can be obtained by differentiating term by term; that is, 


РО) = Yo nay (x – xo)", (4.5.9) 


n=1 
which can also be written as 
oo 
Го) = YO + Vangie — хо)". (4.5.10) 
n=0 


This series also has radius of convergence R. 


Proof First, the series in (4.5.9) and (4.5.10) are the same, since the latter is obtained 
by shifting the index of summation in the former. Since 


[ 


Tim ((n + Djan)” = Tim (n + 1)" |а|" 
n—oo п->со 


( lim (n + pum (iim 1") (Ехегсіѕе 4.1.30(а)) 
п->со п->со 


EE log(n 4- 1) (mm | jm. t. 1 
Cla Р к | wee " J-R m 
the radius of convergence of the power series in (4.5.10) is R (Theorem 4.5.2). Therefore, 


the power series in (4.5.10) converges uniformly in every interval [xo — r, xo +7] such that 
0 <r < R, and Theorem 4.4.20 now implies (4.5.10) for all x in (xo — R, xo + R). [| 


Theorem 4.5.4 can be strengthened as follows. 


Theorem 4.5.5 A power series 
f(x) = Max — xo)" 
=0 


with positive radius of convergence R has derivatives of all orders in its interval of convergence, 
which can be obtained by repeated term by term differentiation; thus, 


оо 


f(x) = b» nin — T--(n—k + Das(x xy. (4.5.11) 
n=k 


The radius of convergence of each of these series is R. 


Proof The proof is by induction. The assertion is true for k = 1, by Theorem 4.5.4. 
Suppose that it is true for some k > 1. By shifting the index of summation, we can rewrite 
(4.5.11) as 


со 


f(x) = G +k)(n+k—-1)-+-(n+ Dadnig(x —xo)', |x —xo| < R. 


n=0 
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Defining 
bn = (n 4-k)(n + k —1)---(n + Па, (4.5.12) 


we rewrite this as 
oo 
fO (x) = Y bx xo)", |x хо| < R. 
n=0 


By Theorem 4.5.4, we can differentiate this series term by term to obtain 


со 


JED) = У `прЬ,(х =) «Ded < R. 
п=1 
Substituting from (4.5.12) for b, yields 


SED) = SUC +k)(n+k-—1)--- (n + 1)паһ+к(х— хо)", |x—xo| < R. 


n=1 


Shifting the summation index yields 


оо 
fH V(x) = у, n(n — 1)--- (и – k)an (x — xo ^, |х хо] < R, 
n=k+1 
which is (4.5.11) with k replaced by k + 1. This completes the induction. ш 


Example 4.5.6 In Example 4.4.10 we saw that 


Repeated differentiation yields 


k! 2 
пут = 2,n0-D--(-k Dant 
n=k 


= У (п + к) +k—-1)---@4+ Dx", |x] «1, 
n=0 


so 
oo 
ast = 2 ( a к) |x| < 1. 
Example 4.5.7 Ву the method of Example 4.5.5, it сап be shown that the series 
oo х2п+1 оо y 
S(x) = 2 CD's TDI and C(x) = do" Qi 
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converge for all x. Differentiating yields 


оо 


so = УС усу = С@) 


n=0 


and 
oo x2n- х2" +1 


C'() = 5 C1 "o --re) "onthi а 


n=1 


These results should not surprise you if you i a 
S(x) =sinx and C(x) = соѕх. 
(We will soon prove this.) 


Theorem 4.5.5 has two important corollaries. 


Corollary 4.5.6 If 
f(x) = ya — xo)”, |x—xo| < R, 


then 
f™ (xg) 


аһ = 
n! 


Proof Setting x = хо in (4.5.11) yields 
f (xo) = Ер. 


Corollary 4.5.7 (Uniqueness of Power Series) /f 


oo oo 
> an (x — xo)" = у, һһ(х — хо)" 
п=0 п=0 
for all x in some interval (xo — r, xo 4- r), then 


an =bn, п> 0. 


Proof Let 


= —S(x). 


f(x) = у, an(x = хо)? and g(x) = у, bn(x = хо)". 


п=0 
From Corollary 4.5.6, 


(n) (n) 
_ Атоо) "E NE (xo). 
n! n! 


(4.5.13) 


(4.5.14) 


(4.5.15) 
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From (4.5.13), f = g in (xo — г, xo + r). Therefore, 
f €? (xg) = g™ (xo), п > 0. 


This and (4.5.15) imply (4.5.14). ш 


Theorems 4.4.19 and 4.5.2 imply the following theorem. We leave the proof to you 
(Exercise 4.5.15). 


Theorem 4.5.8 If x1 and x» are in the interval of convergence of 
oo 
Ро) = У`а„(х — x0)", 
n=0 


then 


x2 оо 

ап +1 п+1 

(x)dx = x2 -3Xg) ^ — (xı — xo ; 

[os Ye [02 о) = e xt] 
1 п=0 

that is, a power series may be integrated term by term between any two points in its interval 

of convergence. 


Example 4.5.16 presents an application of this theorem. 


Taylor’s Series 


So far we have asked for what values of x a given power series converges, and what are 
the properties of its sum. Now we ask a related question: What properties guarantee that a 
given function f can be represented as the sum of a convergent power series in x — xo? A 
partial answer to this question is provided by what we already know: Theorem 4.5.5 tells us 
that f must have derivatives of all orders in some neighborhood of xo, and Corollary 4.5.6 
tells us that the only power series in x — xo that can possibly converge to f in such a 
neighborhood is 


9o qm) 
yl шу, (4.5.16) 
=0 ` 


This is called the Taylor series of f about xo (also, the Maclaurin series of f , if xo = 0). 
The mth partial sum of (4.5.16) is the Taylor polynomial 


m pn) 
то) = у 9 s — xg, 
n=0 ` 


defined in Section 2.5. 


The Taylor series of an infinitely differentiable function f may converge to a sum dif- 
ferent from f. For example, the function 


fe? x £0, 
f= 16 dun 
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is infinitely differentiable on (—oo, оо) апа f ™ (0) = 0 for n > 0 (Exercise 2.5.1), so its 
Maclaurin series is identically zero. 


The answer to our question is provided by Taylor’s theorem (Theorem 2.5.4), which 
says that if f is infinitely differentiable on (a, b) and x and xo are in (a, b) then, for every 
integer n > 0, 

PR (сп) 

(n + 1)! 


where ср is between x and xo. Therefore, 


9o p(n) 
у= >, / £w (x — xo)" 
n=0 ` 


f(x) — Т„(х) = (xt. (4.5.17) 


for an x in (a, b) if and only if 


yen (cn) 


х = n+l _ 
GED cce =O 


It is not always easy to check this condition, because the sequence {cy} is usually not pre- 
cisely known, or even uniquely defined; however, the next theorem is sufficiently general 
to be useful. 


Theorem 4.5.9 Suppose that f is infinitely differentiable on an interval I and 


lim Teu = =0. (4.5.18) 


n—oo n! 
Then, if xo € T°, the Taylor series 
29 f(y 
У. Еа a, 
= n 
converges uniformly to f on 


I, = I A [хо = р, хо + r]. 


Proof From (4.5.17), 


| £e t9, < MM 


|f Tolle $a ^ TET 


so (4.5.18) implies the conclusion. [| 


Example 4.5.8 If f(x) = sinx, then || f™ |c) = 1, k = 0. Since 


r” 


lim —=0, 0<r< œ 
n—oo n! 
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(Example 4.1.12), (4.5.18) holds for all 7. Since 


г" (о) = 0 and femtD@) — (—1)”, And). 


we see from Theorem 4.5.9, with J = (—оо, оо), хо = 0, and r arbitrary, that 


sinx — "» 


n=0 


2п+1 


X 
Ол” =бо<х < о, 


and the convergence is uniform on bounded sets. 


A similar argument shows that 
oo х2" 
cosx = —])———, -w <x < оо, 
2 ) (2n)! 


with uniform convergence on bounded sets. 


Example 4.5.9 If f(x) = e*, then f(x) = ех and | f ||; = e", k > 0, if 


I = [-r, r]. Since 
n 


TE aa 
lim —e = 0, 
n> n! 
we conclude as in Example 4.5.8 that 
оо х" 
ех = у —, –оо<х < о, 


with uniform convergence on bounded sets. 


Example 4.5.10 If f(x) = (1 + х)“, then 


(n) (n) 
0 = ()‹ + х)", во I = () (4.5.19) 


LO 


is called the binomial series. We saw in Example 2.5.3 that this series equals (1 + x)? for 
all x if q is a nonnegative integer. We will now show that if q is an arbitrary real number, 
then 


(Example 2.5.3). The Maclaurin series 


У ( х" = /(х)=(%+х)4, O<x <1. (4.5.20) 
n=0 


Since 
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q—n 
n+1 


, 


n—oo n—oo 


(59/6) 


the radius of convergence of the series in (4.5.20) is 1. From (4.5.19), 


| Fe [[го,1] q 
n 


n! 
zn cy 
lim —|| f” ij < [max(1, 27)] lim 
noo n! , п->со 


< [max(1, 2?)] , n0. 


() 


where the last equality follows from the absolute convergence of the series in (4.5.20) on 
(—1, 1). Now Theorem 4.5.9 implies (4.5.20). " 


Therefore, if 0 < r < 1, 


We cannot prove in this way that the binomial series converges to (1 + x)? on (—1, 0). 
This requires a form of the remainder in Taylor's theorem that we have not considered, or 
a different kind of proof altogether (Exercise 4.5.20). The complete result is that 


oo 
@+х = У) JA EP (4.5.21) 
n 
n=0 


for all q, and, as we said earlier, the identity holds for all x if g is a nonnegative integer. 
Arithmetic Operations with Power Series 


We now consider addition and multiplication of power series, and division of one by an- 
other. 


We leave the proof of the next theorem to you (Exercise 4.5.21). 


Theorem 4.5.10 If 


f(x) = X anx- хо)", |x- xol < Ri. (4.5.22) 
=0 

g(x) = у ba(w — xo)”, |x — xo| < Ro, (4.5.23) 
n=0 


and a and В are constants, then 


оо 


aif (x) + Bg(x) = У (wan + Bhn)(x — хо)", x — xol < R, 


n=0 


where R > тіп{ А, К). 
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Theorem 4.5.11 If f and g are given by (4.5.22) and (4.5.23), then 


F(x)g(x) = У сп(х – хо)", |x—xo| < R 
=0 


n n 
where 
Cg = ) arbn-r = ) ün—r by 
r=0 r=0 


and R > min( R,, А}. 


(4.5.24) 


Proof Suppose that А < R2. Since the series (4.5.22) and (4.5.23) converge abso- 
lutely to f(x) and g(x) if |x — xo| < R1, their Cauchy product converges to f(x)g(x) if 


|x — xo| < Ri, by Theorem 4.3.29. The nth term of this product is 
r=0 


r=0 


Example 4.5.11 If 


1 = 
Р) =т= Ух » (|x| <1, 
n=0 
and 
oo 
g(x) = Y ых", |х| < А, 
n=0 
then 
(x) S 
L— = уз, |x| < min(1, R}, 
where 


Sn = (ро + (1)b1 +--+ + (hn 
= bo t by +--+ bn. 


Example 4.5.12 From the paragraph following Example 4.5.10, 
ST 
1 P у т 1, 
| Tut n=0 (7): | i < 


and 


(1+ х) = у, o |x| « 1. 


n=0 


У а(х — xo) bn-r (x — x9)" = (>: se (x—xo —c(x—-xo). m 
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Since 


ataata = a+r 


n=0 


while the Cauchy product is У? у Cn x”, with 


500) 


Corollary 4.5.7 implies that 
This yields the identity 


valid for all p and q. 


The quotient 


of two power series 


oo 
h(x) = Dera = хо)", |x—xo| < Ri, 
п=0 
апа 


оо 
g(x) = УЬ хо)", |x хој < Ra, 
п=0 
can be represented as a power series 
oo 
Ро) = Yo an(x — хо)" 
n=0 


with a positive radius of convergence, provided that 


bo = g(xo) #0. 


(4.5.25) 


(4.5.26) 


This is surely plausible. Since g(xo) 4 0 and g is continuous near хо, the denominator 
of (4.5.25) differs from zero on an interval about хо. Therefore, f has derivatives of all 
orders on this interval, because g and л do. However, the proof that the Taylor series of f 
about xo converges to f near xo requires the use of the theory of functions of a complex 
variable. Therefore, we omit it. However, it is straightforward to compute the coefficients 


in (4.5.26) if we accept the validity of the expansion. Since 


fGx)g(x) = A(x), 
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Theorem 4.5.11 implies that 
n 
» arbn-r =сһ, п> 0. 
=0 


Solving these equations successively yields 


1 n=l 
(eX) п > 1. 


It is not worthwhile to memorize these formulas. Rather, it is usually better to view the 
procedure as follows: Multiply the series f (with unknown coefficients) and g according 
to the procedure of Theorem 4.5.11, equate the resulting coefficients with those of h, and 
solve the resulting equations successively for ao, a1, .... 


Example 4.5.13 Suppose that we wish to find the coefficients in the Maclaurin series 
tanx = ао + a1x + азх? Tee. 


We first observe that since tan x is an odd function, its derivatives of even order vanish at 
хо = 0,80 d2m = 0, т > 0. Therefore, 


tanx = ах + азх? + asx? Tee. 


Since | 
sin x 
tanx = 
cos X 
it follows from Example 4.5.8 that 
x^ Ax 
— dress 
aix +a3x? + а5х? +- = E 120 
x x 
Le 
2 24 


SO 
x? xí x? x? 

(aix + азх? + ах? ts) {1-5 ++) х-н, 

2 24 


ог, according to Theorem 4.5.11, 


ay аз a x 
ах + (аз — Z) + (ав— 2) tax - Sto te.. 

From Corollary 4.5.7, coefficients of like powers of x on the two sides of this equation 
must be equal; hence, 


a, = 1, а3=— ===, дв = + 


1 1 ЕА lay 1 1 " 1/1 1 (1) 2 
ау = 1, аз = == — = -, а = — — — = — = —, 
! ? 6 3 ^7 po 2\3 
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Therefore, 
3 


t Ыы е 
anx = x + — + х tee, 
3 15 


Example 4.5.14 To find the reciprocal of the power series 
oo x" 
= x— 
g(x) =1+e THX ү 
n= 


we let = 1 in (4.5.25). If 


then 


x^g 
1 = (ao tax tans ам?) (aee meme) 


а 
= 2ag + (ao + 2а1)х + (> +aı + 2а») x? 


a a 
+(Ẹ +F ta +243) х? +. 


From Corollary 4.5.7, 
2a9 = 1, 
ао + 2a, = 0, 
ao 
E +a, + 2а = 0, 


а а 
z t7 +42 +243 = 0. 


Solving these equations successively yields 


1 
ао = PL 
ao 1 
а= = = –1, 
2 4 
1 1/1 1 
= = | — = —— —— — = 0, 
a 7-3 (F ta) AG j 
1 /do a, 1 1 1 
= = [| i—i = —— — — — 0 = — 
a3 zo 4 du) :(5 = +0) 48 
SO 
1 1 x x? 
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Example 4.5.15 To find the reciprocal of 


oo x" 
== Кый 
g(x)=e = у T (4.5.27) 
n=0 
we again let h = 1 in (4.5.25). If 
оо 
(е^)! = У anx”, 
n=0 
then 
oo oo x oo 
— n — 
1 = (Zo ) p =) = У cnx , 
n= n=0 n= 
where 


From Corollary 4.5.7, со = ag = І and c, = 0 ifn > 1; hence, 
n-1 


ar 

а = – >> E (4.5.28) 
r=0 

Solving these equations successively for ag, a1, ... yields 


1 
ay 7-445) = —1, 


І І І 
a =— Eo + =? = 5, 


1 1 1/1 1 

ые E Шы Т Ө) 2E: 
1 i 1 1 1l f1 1 1 _ 1 
[a + OD +55 (5) жт (-g) = ae 


(-D* 

k! 
forO < k < 4and are led to conjecture that this holds for all k. To prove this by induction, 
we assume that it is so for 0 < k < n — 1 and compute from (4.5.28): 


SS 1 (y 
c Р? (n—r) 


а4 = — 
From this, we see that 


ак = 


r! 
1 


n—1 
al Loy (") (Exercise 1.2.19(a)) 
LC» 


n! 


(Exercise 1.2.19(b)). 
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Thus, we have shown that 


oo х" 
x\-1 _ qnit. 
ey? = ) 0". 
n=0 
Since this is precisely the series that results if x is replaced by —x in (4.5.27), we have 
verified a fundamental property of the exponential function: that 


(p^)! = ех. 


This also follows from Example 4.3.26. 


Abel’s Theorem 


From Theorem 4.5.4, we know that a function f defined by a convergent power series 
oo 
Јо) = ) ах хо)", |x- xol < R, (4.5.29) 
=0 


is continuous in the open interval (xo — R, xo + А). The next theorem concerns the behavior 
of f as x approaches an endpoint of the interval of convergence. 


Theorem 4.5.12 (Abel’s Theorem) Let f be defined by a power series (4.5.29) 


with finite radius of convergence R. 
(a) IfY а, К" converges, then 


lim (х) = Sak 
n=0 


x—(xo4-R)— 


(b) FY 59-1" a, К" converges, then 


оо 


о) = OCD" anR". 


lim 
x—>(x9—R)+ 
n=0 


Proof We consider a simpler problem first. Let 


£0) = 3 by" 
n=0 


and 
oo 
lb =s (finite). 
n=0 
We will show that 


me g(y) = 5. (4.5.30) 
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From Example 4.5.11, 


оо 
80у) = (1 у) Уау". (4.5.31) 
п=0 
where 
Sn = bo + bi o + bn. 
Since 
1 = сы 
= ;»" and therefore 1=(1-y) y", yl <1, (4.5.32) 
n=0 n=0 


we can multiply through by s and write 


оо 
s=(l-y)> sy", |у|<1. 


n=0 


Subtracting this from (4.5.31) yields 


800) -s=(1-y) У —-s)y", |у|<1. 


n=0 


If € > 0, choose N so that 
lsn—s| «e if nz N-«I. 


Then, if 0 « y « 1, 


Un 


N оо 
Ig) = 1 01у) У 1 —sl" 01у) У Is sl»" 
п=0 n=N+1 


oo 
«(0- Is —sly" + 0 у) 37^ y" 


n=0 n=0 


N 
«ü-»» Sn —S| e, 


because of the second equality in (4.5.32). Therefore, 


lg) —5] < 2€ 


N 
(l—y) Y Iss — s| « e. 


n=0 
This proves (4.5.30). 
To obtain (a) from this, let bn = an R” and g(y) = f(xo + Ry); to obtain (b), let 
bn = (—1)"a, R” and g(y) = f(xo — Ry). ш 
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Example 4.5.16 The series 


1 oo 
fG) = y= 20cm 
n=0 


diverges at x = 1, while limy.,1— f(x) = 1/2. This shows that the converse of Abel’s 
theorem is false. Integrating the series term by term yields 


oo ntl 
log(1 + x) = 31-1" 


n=0 


, |x| <1, 
n+1 


where the power series converges at x = 1, and Abel’s theorem implies that 


oo (-1yH 
log2 — ———— —. 
P уз n+1 


Example 4.5.17 If q > 0, the binomial series 


Ж)” 


converges absolutely for x = +1. This is obvious if q is a nonnegative integer, and it 
follows from Raabe's test for other positive values of q, since 


ün4-1 = q q E —q n>q 
аһ п+1 п n+l’ | 
апа 
im n ( ган. 1) = im n (24 - ) 
n—oo ап п->со n+1 
n 


= lim 
n>œn + 1 


Therefore, Abel’s theorem and (4.5.21) imply that 


У) () =2 and Y (—1)" | =0, @>0. 
п=0 


п=0 


4.5 Exercises 


1. Тһе possibilities listed in Theorem 4.5.2(c) for behavior of a power series at the 
endpoints of its interval of convergence do not include absolute convergence at one 
endpoint and conditional convergence or divergence at the other. Why can’t these 
occur? 
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2. Find the radius of convergence. 


о) (527) р CD x — (b)x2( - 1)” 


n 


(c) У (2+ sin T) (x +2)" (d) Улут" 


QNI 


3. (a) Prove: If {a,r”} is bounded and |x; — xo| < r, then Y, as (x1 — xo)" con- 
verges. 
(b) Prove: If Уа, (x — xo)" has radius of convergence R and |x; — xo| > R, 
then (as (x1 — xo)" } is unbounded. 
4. Prove: If g is a rational function defined for all nonnegative integers, then X` a, x" 
and $a, g(n)x" have the same radius of convergence. HINT: Use Exercise 4.1.30(a). 
5. Suppose that f(x) = > an(x — xo)" has radius of convergence R and 0 < r < 
Rı < R. Show that there is an integer k such that 


" k+1 Ri 
x — 
Ж Ri Ri =F 


k 
f(x) — Sante — xo)" 


n=0 


if |x — хо < r and k > k. 


6. Suppose that k is a positive integer and 
оо 
fœ = У аах" 
п=0 
has radius of convergence А. Show that the series 


ga) = fO = у ax 


п=0 
has radius of convergence R!/*, 
7. Complete the proof of Theorem 4.5.3 by showing that 
(a) R-0iflim; оо |ал+1|/|аяп| = оо; 
(b) А =o if limp sos |an41|/|an| = 0. 


8. Find the radius of convergence. 


(a) > (овл)х” (b) У 2"л2(х + 1)" 
п 2n n „п? +1 РА 
(c) У `1) (2): (d) 3-0 a eei 
n” 5 a(a+1)---(@+n-1) , 
(е) 5,62 О 


(a, В = negative integer) 
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9. Suppose that a, 5 0 for n sufficiently large. Show that 


(a) lim = 


п->со ап 


< lim |а„|!'” and(b) lim |а„|!'” < Tim 
ИСО поо поо 


п 
Show that this implies Theorem 4.5.3. 
10. Given that 


Ó 


use Theorem 4.5.4 to express > 20 n? x" in closed form. 
11. The function 


29 — 1)" 2п+ 
Jp(x) = у, T (5) (p = integer > 0) 


n=0 
is the Bessel function of order p. Show that 
(a) Jj 2-4. 
(b) „= ipi — /р+1), p21. 
(с) a4 T Ge -— p’)Jp = 0. 
12. Given that the power series f(x) = > уу dnx” satisfies 


f(x) = —2xf(x), fO)=1, 


find {an}. Do you recognize f? 
13. Let 


оо 
(х) = » an”, |х| < R, 
n=0 


and g(x) = f(x*), where k is a positive integer. Show that 
(kn)! 


n! 


g?O)=0 if rzkn and g*%(0) = f™O), n0. 


14. Let " 
F(x) =X anx- хо)", |x-xo| < R, 
n=0 


апа f(t,) = 0, where t, # хо and limy+oot, = хо. Show that f(x) = 0 
(|x — xo| < R). HINT: Rolle’s theorem helps here. 


15. Prove Theorem 4.5.8. 
* logt 
f SE dt 
1 t-l 


16. Express 
as a power series in x — | and find the radius of convergence of the series. 
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17. 


18. 


19. 


20. 


21. 
22. 


23. 


24. 


25. 


26. 


By substituting —x? for x in the geometric series, we obtain 


1 oo 
ree Lee open 
=0 


Use this to express f(x) = Tan !x (f(0) = 0) as a power series in x. Then 
evaluate all derivatives of f at xo = 0, and find a series of constants that converges 
to 1/6. 


Prove: If 
oo 
F(x) = Yo an(x — хо)". |x хо] < R, 
n=0 


and F is an antiderivative of f on (xo — R, xo + R), then 


a 
ee x0)", |x — xo| < R, 


Е(х) = С+ У? 
п=0 


where С is а constant. 


Suppose that some derivative of f can be represented by a power series in x — xo 
in an interval about xo. Show that f and all its derivatives can also. 


Verify Eqn. (4.5.21) by showing that 


oo 
a+ Y (е) =1, |х| <1, 


п=0 
HINT: Differentiate. 
Prove Theorem 4.5.10. 


Find the Maclaurin series of cosh x and sinhx from the definition in Eqn. (4.5.16), 
and also by applying Theorem 4.5.10 to the Maclaurin series for ех апае“. 


Give an example where the radius of convergence of the product of two power series 
is greater than the smaller of the radii of convergence of the factors. 


Use Theorem 4.5.11 to find the first four nonzero terms in the Maclaurin. 


(a)e*sinx (b) (c) 225 (d) (sin x) log(1 + x) 


e 
1+ x? 
Derive the identity 
2 sin x cos x = sin2x 


from the Maclaurin series for sin x, cos x, and sin 2x. 


(a) Given that 


oo 
(0 —2xt x?) = V PO, |х| <1, (A) 
n=0 


27. 


28. 


29. 


30. 


31. 
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if —1 « t < 1, show that Po(t) = 1, P(t) = t, and 
n-A (t). n = 1. 


1 п 
tP,(t) — P, 
п(0) n+1 


HINT: First differentiate (A) with respect to x. 


n+ 
Pa+1¢) = п +1 


(b) Show from (a) that P, is a polynomial of degree п. It is the nth Legendre 
polynomial, and (1 —2xt + x?)~'/? is the generating function of the sequence 


{Pn}. 


Define (if necessary) the given function so as to be continuous at хо = 0, and find 
the first four nonzero terms of its Maclaurin series. 


cos x 

(a) Ž aa (b) TEE (c) sec x 
sin 2x 

(d) x esc x (e) pre 


Let ао = ау = 5 and Gn41 = аһ = баһ-1, п> 1. 

(a) Express F(x) = 155.9 an x" in closed form. 

(b) Write F as the difference of two geometric series, and find an explicit formula 
for an. 


Starting from the Maclaurin series 


x +1 
Зат |х| <1, 


use Abel’s theorem to evaluate 


Genera (n+ E +2) 


In Example 4.5.17 we saw that 
oo 
»( =27, а>0. 
n 
n=0 


Show that this also holds for —1 < q < 0, but not for q < —1. HINT: See Exer- 
cise 4.1.35. 


(a) Prove: If У o bn converges, then the series g(x) = Уу-у bax” converges 
uniformly on [0, 1]. HINT: /f € > 0, there is an integer N such that 


lbn + ра +: bs| «€ if n,m>N. 
Use summation by parts to show that then 
lux" + bx" +--+ 54x" | Se if US ek <1, п,т> М. 


This is also known as Abel’s theorem. 
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32. 


33. 


34. 


(b) Show that (a) implies the restricted form of Theorem 4.5.12 (concerning g) 
proved in the text. 


Use Exercise 4.5.31 to show that if У? уа», Уу-у bn, and their Cauchy product 
X d Cn all converge, then 


&96-£- 
n=0 n=0 n=0 
Prove: If 


оо 
g(x) = » bx. |x| < 1, 
п=0 


апа b, > 0, then 
oo 
у, b, = lim g(x) (finite or infinite). 
=o x—1— 
Use the binomial series and the relation 
d 
— (sin! x) = (1 — x2)? 
dx 


to obtain the Maclaurin series for sin ! x (sin ! 0 = 0). Deduce from this series 
and Exercise 4.5.33 that 


» (7 1 NE 
m 
= \n 2? On--1) 2 


CHAPTER 5 


Real-Valued Functions 


of Several Variables 


IN THIS CHAPTER we consider real-valued function of n variables, where n > 1. 


SECTION 5.1 deals with the structure of IR”, the space of ordered n-tuples of real numbers, 
which we call vectors. We define the sum of two vectors, the product of a vector and a 
real number, the length of a vector, and the inner product of two vectors. We study the 
arithmetic properties of R”, including Schwarz’s inequality and the triangle inequality. We 
define neighborhoods and open sets in IR", define convergence of a sequence of points in 
R”, and extend the Heine—Borel theorem to IR". The section concludes with a discussion 
of connected subsets of IR". 


SECTION 5.2 deals with boundedness, limits, continuity, and uniform continuity of a func- 
tion of п variables; that is, a function defined on a subset of IR". 


SECTION 5.3 defines directional and partial derivatives of a real-valued function of n 
variables. This is followed by the definition of differentiablity of such functions. We define 
the differential of such a function and give a geometric interpretation of differentiablity. 


SECTION 5.4 deals with the chain rule and Taylor's theorem for a real-valued function of 
n variables. 


5.1 STRUCTURE OF n" 


In this chapter we study functions defined on subsets of the real n-dimensional space R”, 
which consists of all ordered n-tuples X = (x1, x2, ..., x4) of real numbers, called the 
coordinates or components of X. This space is sometimes called Euclidean n-space. 


In this section we introduce an algebraic structure for IR". We also consider its topologi- 
cal properties; that is, properties that can be described in terms of a special class of subsets, 
the neighborhoods іп R”. In Section 1.3 we studied the topological properties of R1, which 
we will continue to denote simply as IR. Most of the definitions and proofs in Section 1.3 
were stated in terms of neighborhoods in IR. We will see that they carry over to IR" if the 
concept of neighborhood in R” is suitably defined. 
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Members of R have dual interpretations: geometric, as points on the real line, and alge- 
braic, as real numbers. We assume that you are familiar with the geometric interpretation 
of members of R? and IR? as the rectangular coordinates of points in a plane and three- 
dimensional space, respectively. Although IR" cannot be visualized geometrically if n > 4, 
geometric ideas from IR, R?, and R? often help us to interpret the properties of IR" for 
arbitrary n. 


As we said in Section 1.3, the idea of neighborhood is always associated with some 
definition of “closeness” of points. The following definition imposes an algebraic structure 
on IR", in terms of which the distance between two points can be defined in a natural way. 
In addition, this algebraic structure will be useful later for other purposes. 


Definition 5.1.1 The vector sum of 


X = (x1, X2,...,Xn) and Y= (yi у2,..., yn) 


X +Y = (x1 + y1, X2 yas... Xn + Yn). (5.1.1) 


If a is areal number, the scalar multiple of X by a is 


aX = (ахі,ахә,...,ахһ). (5.1.2) 
ш 


Note that “+” has two distinct meanings in (5.1.1): on the left, “+” stands for the newly 
defined addition of members of R” and, on the right, for addition of real numbers. However, 
this can never lead to confusion, since the meaning of “+” can always be deduced from 
the symbols on either side of it. A similar comment applies to the use of juxtaposition to 
indicate scalar multiplication on the left of (5.1.2) and multiplication of real numbers on 
the right. 


Example 5.1.1 In R^, let 
X = (1,-2,6,5) and Y= (3,-5,4,4). 


Then 
X Y = (4,-7, 10,2) 


and 
6X = (6, —12, 36, 30). ш 


We leave the proof of the following theorem to you (Exercise 5.1.2). 
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Theorem 5.1.2 /f X, Y, and Z are in R" and a and b are real numbers, then 

(a) X-- Y = Y + X (vector addition is commutative). 

(b) (X-- Y) 4- Z 2 X+ (Y + Z) (vector addition is associative). 

(c) There is a unique vector 0, called the zero vector, such that X -- 0 — X for all X in 
R”. 

(d) For each X іп R” there is a unique vector —X such that X + (—X) = 0. 

(e) a(bX) = (ab)X. 

(f) (a+ b)X 2 aX + bX. 

(g) a(X-4 Y) 2 aX t aY. 

(h) IX- X. 


Clearly, 0 = (0,0,...,0) and, if X = (x1, x2, ..., Xn), then 
—X = (—x1,—X2,..., —Xn ). 


We write X + (—Y) as X — Y. The point 0 is called the origin. 


A nonempty set V = (X, Y, Z,...}, together with rules such as (5.1.1), associating a 
unique member of V with every ordered pair of its members, and (5.1.2), associating a 
unique member of V with every real number and member of V, is said to be a vector space 
if it has the properties listed in Theorem 5.1.2. The members of a vector space are called 
vectors. When we wish to emphasize that we are regarding a member of R” as part of this 
algebraic structure, we will speak of it as a vector; otherwise, we will speak of it as a point. 


Length, Distance, and Inner Product 


Definition 5.1.3 The length of the vector X = (x1, X2,...,Xn) is 
Х| = G2 + x24. dee 


The distance between points X and Y is |X — Y|; in particular, |X| is the distance between 
X and the origin. If |X| = 1, then X is a unit vector. ш 


Ifn = 1, this definition of length reduces to the familiar absolute value, and the distance 
between two points is the length of the interval having them as endpoints; for n = 2 and 
n — 3, the length and distance of Definition 5.1.3 reduce to the familiar definitions for the 
plane and three-dimensional space. 


Example 5.1.2 The lengths of the vectors 
X = (1,—2,6,5) and Y= (3, -5, 4,5) 


are 
IX| = (1? + (-2)? + 6? + 52)? = v66 
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and 


IY] = (32 + 5)? + 42 (4/2 = 2 Lt 


The distance between X and Y is 


IX - Y| = (0. — 3? + (—2 + 5? + (6 – 4? + (5 – 1)? = — 


Definition 5.1.4 The inner product X-Y of X = (x1, X2, ..., Xn) and Y = (y1, yo,..., Yn) 
is 
X- Y = му + ху +: + Xnyn. 


Lemma 5.1.5 (Schwarz’s Inequality) If X and Y are any two vectors іп R”, 
then 
X- Y| < |X| |Y], (5.1.3) 


with equality if and only if one of the vectors is a scalar multiple of the other. 


Proof IfY = 0, then both sides of (5.1.3) are 0, so (5.1.3) holds, with equality. In this 
case, Y = ОХ. Now suppose that Y Æ 0 and t is any real number. Then 


0< VG — tyi 


i=1 


n n n 
= xb xy (5.1.4) 


i=1 i=1 i=1 
= |X|? -2(X-Yy + #7/¥/?. 


The last expression is a second-degree polynomial p in t. From the quadratic formula, the 
zeros of p are 
, (Y € (К-ү? RPP 
IY? | 
Непсе, 
X- Y? < |X|’, (5.1.5) 


because if not, then p would have two distinct real zeros and therefore be negative between 
them (Figure 5.1.1), contradicting the inequality (5.1.4). Taking square roots in (5.1.5) 
yields (5.1.3) if Y Z 0. 

If X = tY, then |X. Y| = |X||Y| = |r||Y|? (verify), so equality holds in (5.1.3). 
Conversely, if equality holds in (5.1.3), then p has the real zero to = (X - Y)/|Y |?, and 


у (0 – toyi)? = 0 


i=1 


from (5.1.4); therefore, X = ү. E 
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i 


y=p(t) 


Figure 5.1.1 


Theorem 5.1.6 (Triangle Inequality) /f X and Y are in R”, then 
IX + Y| < |X| + ||, (5.1.6) 


with equality if and only if one of the vectors is a nonnegative multiple of the other. 


Proof By definition, 


n 


n n n 
IX- Y? 2 У +) 2 3 x3 29 i M? 


i=1 i=1 i=1 i=1 


= |X|? + 2(K-Y) + |Y]? (5.1.7) 
< |X|? + 2|X||¥|+|¥|? (by Schwarz’s inequality) 
= (|X| + Үр). 
Hence, 
IX + Y < (Х| + |ү})?. 
Taking square roots yields (5.1.6). 


From the third line of (5.1.7), equality holds in (5.1.6) if and only if X- Y = |X]|Y], 
which is true if and only if one of the vectors X and Y is a nonnegative scalar multiple of 
the other (Lemma 5.1.5). E 


Corollary 5.1.7 IfX, Y, and Z are in R”, then 
IX-Z| x IX- Y|  |Y - Z]. 


Proof Write 
Х-2= (Х- Ү) + (Ү– 2), 


and apply Theorem 5.1.6 with X and Y replaced by X — Y and Y — Z. ш 
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Corollary 5.1.8 /f X and Y are in R”, then 
IX -Y| > ||Х| - |||. 
Proof Since 
X — Y - (X - Y), 


Theorem 5.1.6 implies that 
X| < |V| + |X- Y], 


which is equivalent to 


> 


— |Y| x |X - Yj. 
Interchanging X and Y yields 


Y|- |X| x |Y - X]. 
Since |X — Y| = |Y — X|, the last two inequalities imply the stated conclusion. ш 


Example 5.1.3 The angle between two nonzero vectors X = (х1, х2, хз) and Y = 
(ут, y2, уз) in R? is the angle between the directed line segments from the origin to the 
points X and Y (Figure 5.1.2). 


X 
IXI 
0 
IX-YI 
IYI 
Y 


Figure 5.1.2 


Applying the law of cosines to the triangle in Figure 5.1.2 yields 
IX – Y? = |X|? + |Y]? — 2|X||Y| cos Ө. (5.1.8) 
However, 
IX — Y}? = (x1 — уз)? + (xa — уо)? + (хз — уз)? 
= (Xt + x3 + x$) + OF 3 + y3) - 2001 + xaya + xays) 


= |X|? + |Y]? - 2X - Y. 
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Comparing this with (5.1.8) yields 
X- Y = |X| |Y] cos 0. 
Since | cos 0| < 1, this verifies Schwarz’s inequality іп ЁЗ. 


Example 5.1.4 Connecting the points 0, X, Y, and X + Y in R? or R? (Figure 5.1.3) 
produces a parallelogram with sides of length |X| and |Y| and a diagonal of length |X + Y]. 


Figure 5.1.3 


Thus, there is a triangle with sides |X|, |Y|, and |X + Y|. From this, we see geometrically 
that 


X + Y| < |X| + |Y] 


in R? or R?, since the length of one side of a triangle cannot exceed the sum of the lengths 
of the other two. This verifies (5.1.6) for R? and IR? and indicates why (5.1.6) is called the 
triangle inequality. ш 


The next theorem lists properties of length, distance, and inner product that follow di- 
rectly from Definitions 5.1.3 and 5.1.4. We leave the proof to you (Exercise 5.1.6). 


Theorem 5.1.9 /fX, Y, and Z are members of R” anda is a scalar, then 
(a) |aX| = lal IX]. 

(b) |X| > 0, with equality if and only if X = 0. 

(c) |X — Y| > 0, with equality if and only if X = Y. 

(d) X. Y 2 Y-X. 

(е) X-(Y+Z)=X-Y+X-Z. 

(f) (cX)- Y 2 X- (сү) = c(X- Y). 
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Line Segments in R” 


The equation of a line through a point Хо = (хо, уо, Zo) in IR? can be written parametri- 
cally as 


x = Xo + ut, у= уо + и, Z = Zo +u3t, —00< ft < оо, 
where u1, u2, and u3 are not all zero. We write this in vector form as 
X = Xo +tU, -w<t<o, (5.1.9) 


with U = (и, u2, из), and we say that the line is through Xo in the direction of U. 


There are many ways to represent a given line parametrically. For example, 
X = Xo +sV, —oo«s5«oo, (5.1.10) 


represents the same line as (5.1.9) if and only if V = aU for some nonzero real number a. 
Then the line is traversed in the same direction as s and f vary from —oo to œ ifa > 0, or 
in opposite directions if a < 0. 


To write the parametric equation of a line through two points Хо and X, in R?, we take 
U = X; — 0 in (5.1.9), which yields 


X = Xo + t(X1 — Xo) = 1X1 + (1 —-t)Xo, —oo «t «oo. 


The line segment from Xo to X, consists of those points for which 0 < f < 1. 


Example 5.1.5 The line L defined by 
x=-14+2t, y—3—4t, z=-l, —oo«t«oo, 
which can be rewritten as 
X = (—1,3,—1) + t(2,—4,0), —oo «t «oo, (5.1.11) 


is through Хо = (—1,3,—1) in the direction of U = (2, —4,0). The same line can be 
represented by 
X = (-1,3,-1) + s(1,—2,0), —oo«5s«oo, (5.1.12) 


or by 
X = (-1,3,-1) + t(-4,8,0), -co<t<o. (5.1.13) 
Since 1 
(1, -2,0) = 50-49. 


L is traversed іп the same direction as ¢ and s vary from —oo to оо in (5.1.11) and (5.1.12). 
However, since 
(—4,8,0) = —2(2, —4,0), 
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L is traversed in opposite directions as ¢ and т vary from —oo to oo in (5.1.11) and (5.1.13). 


Setting = 1 in (5.1.11), we see that X, = (1, —1, —1) is also on L. The line segment 
from Xo to X, consists of all points of the form 


Х=1(1,-1,-1) -(1—£)(-1,3, 1), O<t<l. 
These familiar notions can be generalized to IR", as follows: 


Definition 5.1.10 Suppose that Xo and U are in R” and U 5 0. Then the line through 
Xo in the direction of U is the set of all points in IR" of the form 


X = Xo +tU, -w<t<o. 
A set of points of the form 
X = Xo+ tU, <<, 


is called a line segment. In particular, the line segment from Хо to X, is the set of points of 
the form 
X = Xo + (Xi — Хо) = Ху + (1 0)Хо, 0О<т<1. 


Neighborhoods and Open Sets in R" 


Having defined distance in IR", we are now able to say what we mean by a neighborhood 
of a point in IR". 


Definition 5.1.11 If € > 0, the e-neighborhood of a point Xo in IR" is the set 


Ne(Xo)| = (X | IX - Xol < ej. L| 


An e-neighborhood of a point Xo in IR? is the inside, but not the circumference, of the 
circle of radius e about Xo. In R? it is the inside, but not the surface, of the sphere of radius 
€ about Xo. 


In Section 1.3 we stated several other definitions in terms of e-neighborhoods: neigh- 
borhood, interior point, interior of a set, open set, closed set,limit point, boundary point, 
boundary of a set, closure of a set, isolated point, exterior point, and exterior of a set. Since 
these definitions are the same for IR" as for R, we will not repeat them. We advise you to 
read them again in Section 1.3, substituting IR" for IR and Xo for xo. 


Example 5.1.6 Let S be the set of points in R? in the square bounded by the lines 
x = +1, y = +1, except for the origin and the points on the vertical lines x = +1 
(Figure 5.1.4, page 290); thus, 


S = {(х,у)|(х,у) # 0,0), -1 <x < 1, -1< y < 1}. 
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Every point of S not on the lines y = +1 is an interior point, so 
S° = {(х, у) | (х,у) Æ (0,0), —1 < x,y < 1}. 
S is a deleted neighborhood of (0, 0) and is neither open nor closed. The closure of S is 
5 = {(х,у)| -1<х,у х1}, 


and every point of S is a limit point of S. The origin and the perimeter of S form 0S, the 
boundary of S. The exterior of S consists of all points (x, y) such that |x| > 1 or |y| > 1. 
The origin is an isolated point of S^. 


(-1, 1) (1, 1) 


Figure 5.1.4 


Example 5.1.7 If Xo is a point in R" and r is a positive number, the open n-ball of 
radius r about Хо is the set B, (Xo) = {x | [X — Xo| < г}. (Thus, e-neighborhoods are 
open n-balls.) If X; is in S. (Xo) and 


[X — Xj| <€= r— |X — Хо, 


then X is in S, (Xo). (The situation is depicted in Figure 5.1.5 for n = 2.) 


Thus, S, (Хо) contains an e-neighborhood of each of its points, and is therefore open. 
We leave it to you (Exercise 5.1.13) to show that the closure of B, (Xo) is the closed n-ball 
of radius r about Xo, defined by 
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S, (Ko) = {X||X— Xo] <r}. 


r-|X,-X)| 


Figure 5.1.5 


Open and closed n-balls are generalizations to R” of open and closed intervals. 


The following lemma will be useful later in this section, when we consider connected 
sets. 


Lemma 5.1.12 If X; and X» are in S. (Xo) for some r > 0, then so is every point on 
the line segment from X, to X2. 


Proof The line segment is given by 
X-—1X5-(1—10)Xi, 0«t«1. 
Suppose that r > 0. If 
[X4 — Xo| < Г, [X5 — Xo| x UJ. 


and 0 « t < 1, then 


[X — Xo| = |tX2 + (1 — £)X; — tXo — (1 — £)Xo| 
= |t(X2 — Xo) + (1 — 2)X1 — Xo)| 
< t|X2 — Xo| + (1 — £)|X, — Х| 
<tr+ (l-t) =r. 


The proofs in Section 1.3 of Theorem 1.3.3 (the union of open sets is open, the intersec- 
tion of closed sets is closed) and Theorem 1.3.5 and its Corollary 1.3.6 (a set is closed if 
and only if it contains all its limit points) are also valid in R”. You should reread them now. 
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The Heine—Borel theorem (Theorem 1.3.7) also holds in IR", but the proof in Section 1.3 
is valid only for п = 1. To prove the Heine-Borel theorem for general п, we need some 
preliminary definitions and results that are of interest in their own right. 


Definition 5.1.13 A sequence of points {X,} in R” converges to the limit X if 
lim |X, -X| = 0. 
roo 

In this case we write 


lim X, = X. L| 


The next two theorems follow from this, the definition of distance in IR", and what we 
already know about convergence in R. We leave the proofs to you (Exercises 5.1.16 and 
5.1.17). 


Theorem 5.1.14 Let 
X = (X1, X2,...,¥n) and X, = (Xir, X2r,.-.; Xnr) fx 
Then lim, o; X, = X if and only if 


lim xj; xij 1<i<n; 
roo 


that is, a sequence {X,} of points in R” converges to a limit X if and only if the sequences 
of components of {X;} converge to the respective components of X. 


Theorem 5.1.15 (Cauchy's Convergence Criterion) A sequence (X, in 
IR" converges if and only if for each € > 0 there is an integer K such that 


IX, -X,|] «e if rs-kK. 
The next definition generalizes the definition of the diameter of a circle or sphere. 
Definition 5.1.16 If S is a nonempty subset of В", then 
d(S) = sup {X — Y|| X. Y e 5) 
is the diameter of S. If d(S) < оо, S is bounded; if d(S) = оо, S is unbounded. 


Theorem 5.1.17 (Principle of Nested Sets) /f $1, 52,... are closed nonempty 
subsets of R" such that 


$12 $525.52 $,2-- (5.1.14) 
and 
lim d(S,) = 0, (5.1.15) 


then the intersection 
oo 
ies 


contains exactly one point. 
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Proof Let {Х, } be a sequence such that X, є S, (r > 1). Because of (5.1.14), X, € Sk 
ifr > k, so 

|X; — Xs| «d(Sy) if r,s >k. 
From (5.1.15) and Theorem 5.1.15, X, converges to a limit X. Since X is a limit point of 
every Sx and every S, is closed, Xisin every Sx (Corollary 1.3.6). Therefore, Х є І, ѕо 
I Æ 0. Moreover, X is the only point in 7, since if Y є 7, then 


ІХ -Ү| < 4(50), К>1, 


and (5.1.15) implies that Y = X. | 


We can now prove the Heine-Borel theorem for R”. This theorem concerns compact 
sets. As in IR, a compact set in IR" is a closed and bounded set. 


Recall that a collection Jf of open sets is an open covering of a set S if 
SCU{H|He 2}. 


Theorem 5.1.18 (Heine-Borel Theorem) /f H is an open covering of a com- 
pact subset S, then S can be covered by finitely many sets from Ж. 


Proof The proof is by contradiction. We first consider the case where n = 2, so that 
you can visualize the method. Suppose that there is a covering # for S from which it is 
impossible to select a finite subcovering. Since S is bounded, S is contained in a closed 
square 

Т ={(x,y)la1 <x <a, + L,a2 < x < a2 + L} 


with sides of length L (Figure 5.1.6). 


| 

| 

| 
TO TO 
T? TO 

| 

| 

НИНИ — 


Figure 5.1.6 
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Bisecting the sides of T as shown by the dashed lines in Figure 5.1.6 leads to four closed 
squares, TO, TO, TO, and T, with sides of length L/2. Let 


50 = пто, 1<i <4. 


Each SC ), being the intersection of closed sets, is closed, and 


4 
Belly. 


i=1 


Moreover, # covers each 5), but at least one S? cannot be covered by any finite sub- 
collection of 3, since if all the 5) could be, then so could S. Let Sı be a set with this 
property, chosen from S (0. Ss, SO), and SM. We are now back to the situation we 
started from: a compact set Sı covered by J£, but not by any finite subcollection of J£. 
However, S1 is contained in a square Ту with sides of length L/2 instead of L. Bisecting 
the sides of 7; and repeating the argument, we obtain a subset S5 of S; that has the same 
properties as S, except that it is contained in a square with sides of length L/4. Continuing 
in this way produces a sequence of nonempty closed sets 50 (= S), S1, S5, ..., such that 
Sk D Sy44 and d(Sy) < L/2*-V? (k > 0). From Theorem 5.1.17, there is a point X in 
ae S;. Since X є S, there is an open set H in # that contains X, and this H must also 
contain some e-neighborhood of X. Since every X in Sx satisfies the inequality 


ІХ Х| < о А 


it follows that S C Н for k sufficiently large. This contradicts our assumption on J, 
which led us to believe that no Sz; could be covered by a finite number of sets from J. 
Consequently, this assumption must be false: J€ must have a finite subcollection that covers 
S. This completes the proof for n = 2. 


The idea of the proof is the same for n > 2. The counterpart of the square T is the 
hypercube with sides of length L: 


T- {(х1, x2, ... x0) | ai «xjaj-L,i = 1,2,...,п}. 


Halving the intervals of variation of the n coordinates x1, x2, ..., Xn divides T into 2" 
closed hypercubes with sides of length L/2: 


TO = {(1, x2,...,%n) |bi < xi < bi +L/2,1 <i <n}, 


where b; = a; or b; = a; + L/2. If no finite subcollection of # covers S, then at least 
one of these smaller hypercubes must contain a subset of S that is not covered by any finite 
subcollection of S. Now the proof proceeds as for n — 2. E 


The Bolzano—Weierstrass theorem is valid in R”; its proof is the same as in R. 


Connected Sets and Regions 


Although it is legitimate to consider functions defined on arbitrary domains, we restricted 
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our study of functions of one variable mainly to functions defined on intervals. There are 
good reasons for this. If we wish to raise questions of continuity and differentiability at 
every point of the domain D of a function f, then every point of D must be a limit point 
of D?. Intervals have this property. Moreover, the definition of Г E f (x) dx is obviously 
applicable only if f is defined on [a, b]. 

It is not productive to consider questions of continuity and differentiability of functions 
defined on the union of disjoint intervals, since many important results simply do not hold 
for such domains. For example, the intermediate value theorem (Theorem 2.2.10; see also 
Exercise 2.2.25) says that if f is continuous on an interval J and f(x1) < и < f(x2) 
for some x, and x2 in Z, then f(x) = и for some x in J. Theorem 2.3.12 says that f is 
constant on an interval J if f’ = 0 on J. Neither of these results holds if 7 is the union of 
disjoint intervals rather than a single interval; thus, if f is defined on J = (0, 1) U (2,3) 
by 

1, 0<x<1l, 
J09—319. 2x3, 


then f is continuous on J, but does not assume any value between 0 and 1, and f’ = 0 on 
I,but f is not constant. 


It is not difficult to see why these results fail to hold for this function: the domain of f 
consists of two disconnected pieces. It would be more sensible to regard f as two entirely 
different functions, one defined on (0, 1) and the other on (2, 3). The two results mentioned 
are valid for each of these functions. 


As we will see when we study functions defined on subsets of IR", considerations like 
those just cited as making it natural to consider functions defined on intervals in R lead 
us to single out a preferred class of subsets as domains of functions of n variables. These 
subsets are called regions. To define this term, we first need the following definition. 


Definition 5.1.19 A subset S of R” is connected if it is impossible to represent S as 
the union of two disjoint nonempty sets such that neither contains a limit point of the other; 
that is, if S cannot be expressed as 5 = А U B, where 


AZÜ, BZ0, АпВ=@, and АПВ = 0. (5.1.16) 


If S can be expressed in this way, then S is disconnected. 


Example 5.1.8 The empty set and singleton sets are connected, because they cannot 
be represented as the union of two disjoint nonempty sets. 


Example 5.1.9 The space R” is connected, because if R” = AU B with AN B = 0 
and Ап B = Ø, then A C A and B C B; that is, A and В are both closed and therefore 
are both open. Since the only nonempty subset of R” that is both open and closed is R” 
itself (Exercise 5.1.21), one of A and B is R” and the other is empty. 
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Figure 5.1.7 


If X1, Xo,..., Xy are points in R” and L; is the line segment from X; to X;+1, 1 <i < 
k — 1, we say that Ly, L2, ..., Гк form a polygonal path from Х| to Xx, and that Х| 
and X; are connected by the polygonal path. For example, Figure 5.1.7 shows a polygonal 
path in R? connecting (0,0) to (3,3). A set S is polygonally connected if every pair of 
points in S can be connected by a polygonal path lying entirely in S. 


Theorem 5.1.20 An open set S in IR" is connected if and only if it is polygonally 
connected. 


Proof For sufficiency, we will show that if S is disconnected, then S is not polygonally 
connected. Let S — A U B, where A and B satisfy (5.1.16). Suppose that X, € A and 
X» є В, and assume that there is a polygonal path in 5 connecting Х| to X2. Then some 
line segment L in this path must contain a point Y, in A and a point Y2 in B. The line 
segment 

X-—1Yo-(1-f)Y;i, O<t<l, 


is part of L and therefore in S. Now define 
p = sup {т |10 + (1 Yi €A,0xtxcx 1}, 


апа 1еї 
Xp = mv + (1 = p)Ya. 


Then X, € ANB. However, since X; € AU B and ANB = ANB = 0, this is impossible. 
Therefore, the assumption that there is a polygonal path in S from X, to X2 must be false. 
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For necessity, suppose that S is a connected open set and Xo € S. Let A be the set 
consisting of Хо and the points in S can be connected to Xo by polygonal paths in S. Let 
B be set of points in 5 that cannot be connected to Xo by polygonal paths. If Yo є 5, then 
S contains an e-neighborhood № (Yo) of Yo, since 5 is open. Any point Y; in Ne(Yg can 
be connected to Yo by the line segment 


X-1Yi--(1—1)Yo, Oxtxl, 


which lies in Ne(Yo) (Lemma 5.1.12) and therefore in S. This implies that Yo can be 
connected to Xo by a polygonal path in S if and only if every member of №, (Yo) can also. 
Thus, № (Уо) C A if Yo € A, and М (Уо) € B if Yo € B. Therefore, A and В are open. 
Since A N B = Ø, this implies that AN B = AN B = 0 (Exercise 5.1.14). Since A is 
nonempty (Xo € A), it now follows that B = Ø, since if B Z Ø, S would be disconnected 
(Definition 5.1.19). Therefore, A — S, which completes the proof of necessity. " 


We did not use the assumption that S is open in the proof of sufficiency. In fact, we actu- 
ally proved that any polygonally connected set, open or not, is connected. The converse is 
false. A set (not open) may be connected but not polygonally connected (Exercise 5.1.29). 


Our study of functions on IR" will deal mostly with functions whose domains are regions, 
defined next. 


Definition 5.1.21 A region S in К” is the union of an open connected set with some, 
all, or none of its boundary; thus, S? is connected, and every point of S is a limit point of 


a 

Example 5.1.10 Intervals are the only regions in IR (Exercise 5.1.31). The n-ball 

B, (Xo) (Example 5.1.7) is a region in R”, as is its closure S, (X9). The set 
S={(x,y)|x?7+y7 <1 or x7 +y > 4} 


(Figure 5.1.8(a), page 298) is not a region in R2, since it is not connected. The set Sj 
obtained by adding the line segment 


Li: X21(0,2)-(1—10)(0,1), 0<ż<1, 


to S (Figure 5.1.8(b)) is connected but is not a region, since points on the line segment are 
not limit points of S?. The set S2 obtained by adding to S, the points in the first quadrant 
bounded by the circles x? + y? = 1 and x? + y? = 4 and the line segments Lı and 


Lo: X-10,0-4-20,0, 0«t«1 
(Figure 5.1.8(c)), is a region. 
More about Sequences іп R” 


From Definition 5.1.13, a sequence (X, } of points in R” converges to a limit X if and only 
if for every є > 0 there is an integer K such that 


ІХ, -X| «e if г> К. 
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The R” definitions of divergence, boundedness, subsequence, and sums, differences, and 
constant multiples of sequences are analogous to those given in Sections 4.1 and 4.2 for 
the case where n = 1. Since R” is not ordered for n > 1, monotonicity, limits inferior and 
superior of sequences in IR", and divergence to too are undefined for n > 1. Products and 
quotients of members of R” are also undefined if n > 1. 


(a) (b) 


(c) 


Figure 5.1.8 


Several theorems from Sections 4.1 and 4.2 remain valid for sequences in R", with proofs 
unchanged, provided that “| |" is interpreted as distance in IR". (A trivial change is re- 
quired: the subscript n, used in Sections 4.1 and 4.2 to identify the terms of the sequence, 
must be replaced, since n here stands for the dimension of the space.) These include The- 
orems 4.1.2 (uniqueness of the limit), 4.1.4 (boundedness of a convergent sequence), parts 
of 4.1.8 (concerning limits of sums, differences, and constant multiples of convergent se- 
quences), and 4.2.2 (every subsequence of a convergent sequence converges to the limit of 
the sequence). 


Section 5.1 Structure of R” 299 


5.1 Exercises 


With R replaced by R", the following exercises from Section 1.3 are also suitable for this 
section: 1.3.7-1.3.10, 1.3.12-1.3.15, 1.3.19, 1.3.20 (except (e)), and 1.3.21. 


1. FindaX + bY. 
(a) X= (1,2,-3,1), Y=(0,-1,2,0),a =3,b=6 
(b X=(1,-1,2), Y=(0,-1,3),a=-1,b =2 
(c) Х = (5,3,1,1), Ү=(—1,1,5,4),а=+,Р= 1 


PPPE 
2. Prove Theorem 5.1.2. 
3. Find |X|. 
(a) (1,2, —3, 1) (b) (25 b 
(c) (1,2, 21,3, 4) (d) (0, 1 1,0, 21) 


4. Find |X — Y]. 
(a) X= (3.4, > 7 Y = (2,0, —1, 2) 
1 1 1 1 
(b X= byrr Y-(G-e6e-» 
(c) Х = (0,0,0), Y= Q,-12) 
(d) X=(3,-1,4,0,-l), Y= (2,0,1,-4,1) 
5. FindX-Y. 
(a) X= (3,4,5,-4), Y= (3, A 3 3 
(D X-(g m $5. = (5.5.4.4) 
(с) X=(1,2,-3,1,4), Ү = (1,2,—1,3,4) 
6. Prove Theorem 5.1.9. 
7. Find a parametric equation of the line through Xo in the direction of U. 
(a) Xo = (1,2,-3,1), U= (3,4,5,—4) 
(b) Xo = (2,0, —1,2, ©, U=(-l bes 2) 
(c) Хо = (—5, 5,4—1 4 U=- sisi ES 
8. Supposethat U Z 0 and V 2 0. Complete the sentence: The equations 
X=X9+tU, -w<t<o, 
and 
Х= Ху +5У, —oo«s«oo, 
represent the same line іп R” if and only if ... 
9. Find the equation of the line segment from Xo to Х|. 
(а) Xo = (1,-3,4,2), Xi = 2,0,—1,5) 
(b) Xo = (3,1- 2,1,4), X12 Q,0,—1,4,—3) 
(с) Xo = (L2.-), Ху = (0,—1,—1) 
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10. Find sup {e | Ne(Xo) C S}. 
(a) Xo = (1,2,—1,3); S = the open 4-ball of radius 7 about (0, 3, —2, 2) 
(b) Xo = (1,2,-1,3); S = (Gi х2, xs ха) | [xi] < 5,1 <i < 4} 
(c) Xo = (3,3); S = the closed triangle with vertices (2, 0), (2, 2), and (4, 4) 
11. Find (i) 85; (ii) 5; (iii) 5°; (iv) exterior of S. 
(a) S= {(x1, x2, x3, ха) | Ixi| <3,i= 1,2,3} 
(b 5 = {(, у, D|x? +y? <1} 
12. Describe the following sets as open, closed, or neither. 
(а) S = (Gà. x2, хз, xa) | |xi| > 0, x2 < 1, x3 # —2} 
(b) S = {(x1, x2, хз, ха) |х = 1, x3 # —4} 
(c) S= (G1. x2, хз, ха) |i = 1,—3 < x2 < 1, x4 = —5} 


13. Show that the closure of the open n-ball 
B,(Xo) = {X | IX- Xo] < r} 


is the closed n-ball 
В, (Хо) = {X| |X- Хо] <r}. 

14. Prove: If A and B are open and A N B = 0, then An B = АПВ = 0. 
15. Show that if іт, оо X, exists, then it is unique. 
16. Prove Theorem 5.1.14. 
17. Prove Theorem 5.1.15. 
18. Findlim, ,o5 Xr. 

(a) X, = (r sin ES cos e) 

r r 


1 r 41 1" 
b) X,-[1-—. ‚[1+- 
уже ела Ga 
19. Findd(S). 
(а) 5 = {(&,y,x)| [x] < 2,]у| < 1, |z- 2| < 2) 
(x-2*. 0-2? 
b = —— + ——— = | 
(b) s- fony |S = 
(c) S = the triangle in R? with vertices (2, 0), (2, 2), and (4, 4) 
(d) S= {(х1, 2, xn) | Ixil < L,i =1,2,...,n} 
(е) S= (х, у, 2) |х #0, |y] < 1,z > 2} 
20. Prove that d(S) = d (S) for any set S in R”. 
21. Prove: If a nonempty subset 5 of R” is both open and closed, then 5 = IR". 


22. 


23. 


24. 


25. 


26. 
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Use the Bolzano—Weierstrass theorem to show that if S1, 52, ..., Sm, ... is an 
infinite sequence of nonempty compact sets and S1 D $5 D --- D Sm D +--+, then 
(mai Sm is nonempty. Show that the conclusion does not follow if the sets are 
assumed to be closed rather than compact. 


Suppose that a sequence U1, U2, ... of open sets covers a compact set S. Without 
using the Heine-Borel theorem, show that 5 С Em Um for some N. HINT: 
Apply Exercise 5.1.22 to the sets Sn = S N (Uri Us). : 


(This is a seemingly restricted version of the Heine-Borel theorem, valid for the 
case where the covering collection J€ is denumerable. However, it can be shown 
that there is no loss of generality in assuming this.) 


The distance from a point Xo to a nonempty set S is defined by 
dist(Xo, S) = inf {|X — Xo| |X € S}. 
(a) Prove: If S is closed and Xo € IR", there is a point X in S such that 
[X — Xo| = dist(Xo, S). 
HINT: Apply Exercise 5.1.22 to the sets 
Cm = {X|X € S and|X — Xo| < dist(Xo,S)+1/m}, mz 1. 


(b) Show that if S is closed and Xo ¢ S, then dist(Xo, S) > 0. 
(c) Show that the conclusions of (a) and (b) may fail to hold if S is not closed. 
The distance between two nonempty sets S and T is defined by 


dist(S, Т) = inf((X —Y||Xe S. Ye TJ. 


(a) Prove: If S is closed and T is compact, there are points X in S and Y in T 
such that o 
|X — Y| = dist(S, Т). 
HINT: Use Exercises 5.1.22 and 5.1.24. 
(b) Under the assumptions of (a), show that dist(S, T) > Oif S N T = 0. 
(c) Show that the conclusions of (a) and (b) may fail to hold if S or T is not 
closed or T is unbounded. 


(a) Prove: If a compact set S is contained in an open set U, there is a positive 
number r such that the set 


S, = {Х| dis(X, S) <r} 


is contained in U. (You will need Exercise 5.1.24 here.) 
(b) Show that 5, is compact. 
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27. Let Dı and D5 be compact subsets of IR". Show that 
D = {(X%, Y) |X € Dı, Y € D2} 


is a compact subset of R?". 

28. Prove: If S is open and 5 = AU B where AN B = AN B = 0, then A and B аге 
open. 

29.  Givean example of a connected set in IR" that is not polygonally connected. 

30. Prove that a region is connected. 

31. Show that the intervals are the only regions in R. 


32. Prove: A bounded sequence in R" has a convergent subsequence. HINT: Use Theo- 
rems 5.1.14, 4.2.2, and 4.2.5(a). 


33. Define “іт, оо X, = oo" if (X,] is a sequence in IR", n > 2. 


5.2 CONTINUOUS REAL-VALUED FUNCTIONS OF n VARI- 
ABLES 


We now study real-valued functions of n variables. We denote the domain of a function f 
by D y and the value of f at a point X = (x1, х2,..., Xn) by f(X) or /(х1, X2,..., Xn). 
We continue the convention adopted in Section 2.1 for functions of one variable: If a func- 
tion is defined by a formula such as 


JŒ = (Ia ap xbox) 6.2.1) 


or 
g(X) = (1 „к= es (5.2.2) 


n 
without specification of its domain, it is to be understood that its domain is the largest 
subset of IR” for which the formula defines a unique real number. Thus, in the absence of 
any other stipulation, the domain of f in (5.2.1) is the closed n-ball {х | IX| < 1}, while 
the domain of g in (5.2.2) is the set (X | IX| z 1}. 
The main objective of this section is to study limits and continuity of functions of п 
variables. The proofs of many of the theorems here are similar to the proofs of their coun- 
terparts in Sections 2.1 and . We leave most of them to you. 


Definition 5.2.1 We say that f(X) approaches the limit L as X approaches Xo and 
write 
li X)= L 
XX f ) 
if Xo is a limit point of D y and, for every є > 0, there is a ё > 0 such that 
FR) — L| «€ 


for all X in D y such that 
0 « |X — Хо <ô. 
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Example 5.2.1 If 
g(x, y) = 1- x? —2y’, 
then 
lim (х,у) =1-х2-2у2 (5.2.3) 
(х,у) (xo. yo) 


for every (xo, yo). To see this, we write 
а(х, y) — (1— x§ — 2x8) 210 — x? — 2y?) - (0 — ха — 2y9)I 
€ |x? = xg] + 2ly? = уб] 
= |(х + xo)(x — хо)| + 2|(у + yo)G — уо) 
< |X — Xo[(|x + xo] + 2]y + yo)l), 


(5.2.4) 


since 
|х= хо <|KX—Xo| and |y — yo| € |K—Xol. 


If |X — Xo| < 1, then |x| < |xo| + 1 and |y| < |yo| + 1. This and (5.2.4) imply that 
IgG y) - (17 x9 – 2x9) < KIX- Хој if |X—Xo| <1, 
where 
K = (2|xo| + 1) + 2(2|yo| + 1). 


Therefore, if € > 0 and 
[X — Xo| < = miní1, є/ К}, 


then 
|g(x. у) — 0. — хо – 2у0)| < €. 
This proves (5.2.3). E 


Definition 5.2.1 does not require that f be defined at Xo, or even on a deleted neighbor- 
hood of Xo. 


Example 5.2.2 The function 


sin y 1 — x? — 2y? 
y1— x? – 2y? 


is defined only on the interior of the region bounded by the ellipse 


h(x, y) = 


x? + 2у? = 1 


(Figure 5.2.1(a), page 304). It is not defined at any point of the ellipse itself or on any 
deleted neighborhood of such a point. Nevertheless, 


h(x,y) 21 (52.5) 


lim 
(x,y)— (xo. yo) 
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if 
хр +2у =l. (5.2.6) 
To see this, let 
u(x, y) = y1—x?—2y?. 
Then f 
h(x, y) = ишы) (5.2.7) 
u(x, y) 
Recall that | 
. sinr 
lim — = 1; 
r>0 r 


therefore, if € > 0, there is а бу > 0 such that 


sinu 


—1|<є if O«J|u| « &i. (5.2.8) 


и 


From (5.2.3), 


lim 1—x?—2,?) 20 
ucibus d ) 


if (5.2.6) holds, so there is a ё > 0 such that 

0 < u?(x, у) = (1—x?—2y?) < 8? 
if X = (x, y) is in the interior of the ellipse and |X — Xo| < 4; that is, if X is in the shaded 
region of Figure 5.2.1(b). 


Therefore, 
0< u= y1l—x?— 2y? < 8 (5.2.9) 


if X is in the interior of the ellipse and |X — Xo| < 4; that is, if X is in the shaded region of 
Figure 5.2.1 (b). This, (5.2.7), and (5.2.8) imply that 


|h(x, y) - 11 < e 
for such X, which implies (5.2.5). 
y y 
A A 
p | чё COLERE 
P4 N 
ГА \ 
ш | х X 
N "4 
b p 
|o х?+2у?=1 x^2y!z1 


(a) (b) 
Figure 5.2.1 
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The following theorem is analogous to Theorem 2.1.3. We leave its proof to you (Exer- 
cise 5.2.2). 


Theorem 5.2.2 [іх х, f (X) exists, then it is unique. 


When investigating whether a function has a limit at a point Xo, no restriction can be 
made on the way in which X approaches Xo, except that X must be in Dy. The next 
example shows that incorrect restrictions can lead to incorrect conclusions. 


Example 5.2.3 The function 


xy 

X, = 
Jœ») es y 
is defined everywhere іп R? except at (0, 0). Does lim(,y)-+(0,0) f(x, y) exist? If we try 
to answer this question by letting (x, y) approach (0, 0) along the line y — x, we see the 


functional values 
d qe el 
X,xX)—-—-—- 
2х2 2 


and conclude that the limit is 1/2. However, if we let (x, y) approach (0, 0) along the line 
y — —x, we see the functional values 


x? 1 

X, ҲД) = -— = —- 
Ў ) эз 5 
and conclude that the limit equals —1/2. From Theorem 5.2.2, these two conclusions 
cannot both be correct. In fact, they are both incorrect. What we have shown is that 


2 1 : 1 
lim Р(х, х) = 5 апа lim f(x,—x)- => 
Since lim, f(x, x) and іп, о f(x, —x) must both equal Шїшгх,уу—>›(о,о) f (x, y) if the 
latter exists (Exercise 5.2.3(a)), we conclude that the latter does not exist. ig 


The sum, difference, and product of functions of n variables are defined in the same 
way as they are for functions of one variable (Definition 2.1.1), and the proof of the next 
theorem is the same as the proof of Theorem 2.1.4. 


Theorem 5.2.3 Suppose that f and g are defined on a set D, Xo is a limit point of 
D, and 
li X)= Lı, li X) = L2. 
a РОХ) 1 im 8 ) = La 


Then 

lim (f + g)(X) = Lı + L2, (5.2.10) 

X—Xo 
lim (f — g)(X) = L1— L2, (5.2.11) 

X—Xo 
lim (fg)(X) = 111, (5.2.12) 

X—Xo 
and, if Lz # 0, 


lim (2) (Х) = E (5.2.13) 
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Infinite Limits and Limits as |X|—oo 
Definition 5.2.4 We say that f(X) approaches œ as X approaches Xo and write 
Jim £00 = о 
if Xo is a limit point of D y and, for every real number M, there is a ó > O such that 
/(®) > М whenever 0<|X—Xo| <6 and Xe Dy. 
We say that 


am. £00 TFR 


jim De) = oo. 


Example 5.2.4 If 
fX) =0 — =a ey, 
then 
ue fX) = оо 


if |Xo| = 1, because 
1 


Р(Х) = K- Xl 


so 
1 
f(X)»M if 0<|X—Xo| «ó— M 
Example 5.2.5 If 
IUD CONTE 
then lim( y). (,—1) f(x, y) does not exist (why not?), but 


lim X, = оо. 
ар |f Gc. y)| 


To see this, we observe that 
|х + 2y +11 = |(x — 1) + 2(у + 1)| 
< J5|X —Xo| (by Schwarz’s inequality), 
where Хо = (1, —1), so 
1 


1 
uec E acr 
FC 7 aay 31] = V3iX - Xy 
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Therefore, 


1 
х,у))> М if 0«|X- Х| < —. 
If@ у)| | ol MUS 


1 
Sin | —5—— —— 
(= PIAF Э 


x? + y? + 22 


Example 5.2.6 The function 


РО, у,2) = 


assumes arbitrarily large values in every neighborhood of (0, 0, 0). For example, if X; = 
(Xk, Yk, Zk), Where 
1 
Xk = yk = Zk — o————— 
з (+ 2) я 
еп 


fX) = (i T 5) T. 


However, this does not imply that limx.,9 f (X) = oo, since, for example, every neighbor- 
hood of (0, 0, 0) also contains points 


E 1 1 1 
Xk = (== > —] 
V3kn ^3kn 43km 
for which f(X;) = 0. 
Definition 5.2.5 If D ; is unbounded, we say that 


lim f(X) 2L (finite) 
[Х|->со 


if for every € > 0, there is a number R such that 


|f(X)—L|<e whenever |X|> R and Xe Р. 


Example 5.2.7 If 


1 
færd = (aay): 


then 
lim fX)=1. (5.2.14) 
|X|oo 
To see this, we recall that the continuity of cos и at u = 0 implies that for each є > 0 there 
isa ó > 0 such that 
[cosu —1l|«e if |u| <6. 
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Since 
1 1 


= Е 
х2 + 2у2 + za ES |X|?’ 
it follows that if |X| > 1/4/68, then 
1 
(—Ó a 
x? + 2у? +z? 


Therefore, 
| f(X) — Ц <e. 


This proves (5.2.14). 

Example 5.2.8 Consider the function defined only on the domain 
D= {(x, y)|0< y x ax), 0<a<1 

(Figure 5.2.2), by 


1 
f(x, y) = — 
х= у 
We will show that 
lim f(x, y) = 0. (5.2.15) 
|X|oo 


It is important to keep in mind that we need only consider (x, y) in D, since f is not 
defined elsewhere. 


In D, 
x—yzx(l-a) (5.2.16) 
and 
IX)? = x2 4 у? < x 4 a”), 
so 
IX] 
х; 
м1 + а? 
This апа (5.2.16) imply that 
> £4 x) хер 
x — а , , 
д м1 +а? 
so 
A/l-ca? 1 
Ife <==, хер. 
1-а |X| 
Therefore, 
fœ y) « € 
if X € D and 
/1-4a?1 
|X| > — —-. 
1-а є 


This implies (5.2.15). 
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у=ах 


Figure 5.2.2 


We leave it to you to define limjx|o0 f(X) = оо and Ппух оо Р(Х) = —oo (Ехег- 
cise 5.2.6). 

We will continue the convention adopted in Section 2.1: “limx—.x, f(X) exists" means 
that limyx_,x, /(X) = L, where L is finite; to leave open the possibility that L = +оо, we 
will say that “limx_,x, // (X) exists in the extended reals.” A similar convention applies to 
limits as |X| — oo. 

Theorem 5.2.3 remains valid if "limx x," is replaced by “limyx|-,99.” provided that 
D is unbounded. Moreover, (5.2.10), (5.2.11), and (5.2.12) are valid in either version of 
Theorem 5.2.3 if either or both of Lı and Lz is infinite, provided that their right sides are 
not indeterminate, and (5.2.13) remains valid if L5 Æ 0 and L/L is not indeterminate. 


Continuity 


We now define continuity for functions of n variables. The definition is quite similar to the 
definition for functions of one variable. 


Definition 5.2.6 If Xo is in Dy and is a limit point of D у, then we say that f is 


continuous at Xo if 


NUS F(X) = f (Xo). и 


The next theorem follows from this and Definition 5.2.1. 
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Theorem 5.2.7 Suppose that Xo is in D у and is a limit point of D у. Then f is con- 
tinuous at Xo if and only if for each € > 0 there isa ё > 0 such that 


LX — f(Xo)| <€ 


whenever 
[X —Xo| <6 and X€ Dy. 


In applying this theorem when Хо € ро, we will usually omit “and X є D у, it being 
understood that $5 (Xo) C D y. 


We will say that f is continuous on S if f is continuous at every point of S. 


Example 5.2.9 From Example 5.2.1, we now see that the function 


f(x,y) = 1—x* —2y? 


is continuous on R?. 


Example 5.2.10 If we extend the definition of h in Example 5.2.2 so that 


sin y 1 — x? — 2y? 
h(x, у) = = x2 —2y2 , 


1, х? + 2у? = 1, 


x? + 2у? <1, 


then it follows from Example 5.2.2 that Л is continuous on the ellipse 
x? -2y? = 1. 
We will see in Example 5.2.13 that / is also continuous on the interior of the ellipse. 


Example 5.2.11 It is impossible to define the function 


xy 
x2 + y? 


fo. у) = 
at the origin to make it continuous there, since we saw in Example 5.2.3 that 


lim f(x,y) 


Gy) (0,0) 
does not exist. 
Theorem 5.2.3 implies the next theorem, which is analogous to Theorem 2.2.5 and, like 


the latter, permits us to investigate continuity of a given function by regarding the function 
as the result of addition, subtraction, multiplication, and division of simpler functions. 
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Theorem 5.2.8 If f and g are continuous on a set S іп К", then so are f +g, f —g, 
and fg. Also, f/g is continuous at each Xo in S such that g(Xo) 4 0. 


Vector-Valued Functions and Composite Functions 


Suppose that g1, 22. ..., Zn are real-valued functions defined on a subset T of IR", and 
define the vector-valued function G on T by 


G(U) = (g1 (U), g2(U),...,gn(U)), UET. 
Then g1, g2,..., Zn are the component functions of G = (g1, g2,..-, gn). We say that 
li = L = (Lı, L2,..., L 
dim GU) (Lı, L2, n) 


if 
lim g;j(U)- Lj, 1l<i<n, 
020, gi ( ) i SUS 
and that G is continuous at Ug if g1, 22, ..., Zn are each continuous at Оо. 


The next theorem follows from Theorem 5.1.14 and Definitions 5.2.1 and 5.2.6. We omit 
the proof. 


Theorem 5.2.9 For a vector-valued function G, 
din, eU =1 
if and only if for each є > 0 there is a ё > 0 such that 
IG(U) —L| «e whenever 0 < |0- 00| < and Ue Dg. 
Similarly, G is continuous at Оо if and only if for each є > 0 there isa 8 > 0 such that 
|G(U) — G(Ug)| «e whenever |U—Uo| <6 and Ue Dg. 


The following theorem on the continuity of a composite function is analogous to Theo- 
rem 2.2.7. 


Theorem 5.2.10 Let f be a real-valued function defined on a subset of R", and let 
the vector-valued function G = (g1, 22,..., ёп) be defined on a domain Dg in IR". Let 
the set 

T -(U|Ue Dg and 60) єр;} 


(Figure 5.2.3), be nonempty, and define the real-valued composite function 
h=foG 


on T by 
h(U) = f(G(U), UeT. 


Now suppose that Uo is in T and is a limit point of T, G is continuous at Uo, and f is 
continuous at Хо = G(Uo). Then h is continuous at Uo. 
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| R(G) = range of G 
R^ В | R" 
Qe i 


| 
| 
| 
| 
| 
| 
Dg | 
Df 
Figure 5.2.3 


Proof Suppose that є > 0. Since f is continuous at Хо = G(Uo), there is an e > 0 
such that 


Р(Х) — f(G(Uo))| < € (5.2.17) 
if 
[X—G(Up)| <є and Xe Dy. (5.2.18) 
Since G is continuous at Up, there is ad > 0 such that 
|G(U) — G(Up)| <є if [U—Uo| <8 and Ue Dg. 
By taking X = G(U) in (5.2.17) and (5.2.18), we see that 


Ih (U) – h(Uo)| = |f/(G(U) — f(G(Uo))] < € 


[0-00 <6 and UeT. 


Example 5.2.12 If 
f(s) = Vs 
and 
g(x,y) = 1—x? - 2у?, 
then D ¢ = [0, оо], Dg = R?, and 
T= {(x, y)|x7+2y? < 1}. 


From Theorem 5.2.7 and Example 5.2.1, g is continuous on IR2. (We can obtain the same 
conclusion by observing that the functions pı (x, y) = x and р(х, y) = y are continuous 
on R? and applying Theorem 5.2.8.) Since f is continuous on D у, the function 


h(x, y) = f (g(x, y) = y1- x? -— 2y? 


is continuous on T. 
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Example 5.2.13 If 


g(x, y) = y1- х2 – 2y? 


sin 5 

——, 5 x0, 
OL жай 

1, 5=0, 


and 


then D y = (—оо, оо) and 
Dg=T= {(x, у) |x? +25? < 1}. 


In Example 5.2.12 we saw that g (we called it Л Шеге) is continuous оп T. Since / is 


continuous on D y, the composite function h = f o g defined by 


sin y 1 — x? — 2y? 
h(x, y) = = x2 2у2 , 


x? 4+2y? <1, 


1, х? 4+2y? =1, 


is continuous on T. This implies the result of Example 5.2.2. 


Bounded Functions 


The definitions of bounded above, bounded below, and bounded on 


a set S are the same for 


functions of п variables as for functions of one variable, as are the definitions of supremum 


and infimum of a function on a set S (Section 2.2). The proofs of th 
similar to those of Theorems 2.2.8 and 2.2.9 (Exercises 5.2.12 and 


Theorem 5.2.11 If f is continuous on a compact set S in] 
on S. 


e next two theorems are 
5.2.13). 


К”, then f is bounded 


Theorem 5.2.12 Let f be continuous on a compact set S in| 
a= inf f(X), В = sup fX). 
Хє$ XES 


Then 
РОХ) = оа and fX2)= В 
for some X, and X» іп S. 


The next theorem is analogous to Theorem 2.2.10. 


R” and 


Theorem 5.2.13 (Intermediate Value Theorem) Let f be continuous on 


a region S in R”. Suppose that A and B are in S and 
f(A) <и < f(B). 
Then f (C) = u for some C in S. 
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Proof If there is no such C, then S = RU Т, where 


R= {X|X € S and f(X) <и) 
and 

T = {X|X € S and fX) > и). 
If Xo € R, the continuity of f implies that there is ad > 0 such that f (X) < u if |K—Xo| < 
6 and X € S. This means that Хо Є T. Therefore, R N T = 0. Similarly, R N T = 0. 


Therefore, S is disconnected (Definition 5.1.19), which contradicts the assumption that S 
is a region (Exercise 5.1.30). Hence, we conclude that f (C) = u for some C in S. ш 


Uniform Continuity 


The definition of uniform continuity for functions of n variables is the same as for functions 
of one variable; f is uniformly continuous on a subset S of its domain in R” if for every 
€ > 0 there is a ô > 0 such that 


РОХ) — Р(Х?) < є 
whenever |X — X'| < 6 and X, X’ є S. We emphasize again that ô must depend only on є 
and S, and not on the particular points X and X’. 


The proof of the next theorem is analogous to that of Theorem 2.2.12. We leave it to you 
(Exercise 5.2.14). 


Theorem 5.2.14 If f is continuous on a compact set S in R”, then f is uniformly 
continuous on S. 


5.2 Exercises 


With R replaced by К", the following exercises from Sections 2.1 and 2.2 have analogs for 
this section: 2.1.5, 2.1.8 2,111, 2,125, 2.1.28, 2.1.20. 2.1.33, 22,8, 2.29, 2.2.10, 2.2.15, 
2.2.16, 2220 2.2.29. 2.2.30. 


1. Find limx.,x, f(X) and justify your answer with an є—б argument, as required by 
Definition 5.2.1. HINT: See Examples 5.2.1 and 5.2.2. 


(a) f(X)—-3x--4y-z-2, Хо = (1,2,1) 


8 243 
(b 0) = 27, х= (1,10) 
х= у 
(с) fX) = Sit 004 Xo = (—2, 1, -1) 


x + 4y + 22 


5. 


Section 5.2 Continuous Real- Valued Functions of n Variables 315 


(d) fX) = (х2 + y?)log(x? + y2)!?, Xo = (0,0) 


. sin(x — y) _ 
(e fX) = EU IE Xo = (2,2) 
O gone e m. at 


Prove Theorem 5.2.2. 


If іт, хо у(х) = yo and limy+x. f (x, y(x)) = L, we say that f(x, y) ap- 
proaches L as (x, y) approaches (xo, yo) along the curve y — y(x). 
(a) Prove: If lim) s (xo, yo) f(x, у) = L, then f(x, y) approaches L as (х, y) 
approaches (xo, yo) along any curve y — y(x) through (xo, yo). 
(b) We saw in Example 5.2.3 that if 
Xy 
X, => >з 
Jœ») = = y 
then lim). (0,0) J (x, y) does not exist. Show, however, that f(x, y) ap- 
proaches a value La as (x, y) approaches (0,0) along any curve y = у(х) 
that passes through (0, 0) with slope a. Find La. 
(c) Show that the function 


x3y4 
g(x,y) = (х2 + у6)3 


approaches 0 as (х, y) approaches (0, 0) along a curve as described in (b), 
but that Тіт y). (0,0) f (x, y) does not exist. 


Determine whether limx x, f(X) = +оо. 
| sin(x + 2y + 4z)| 


(a) ЛХ) = Gimrayo X0= -LO 
1 
(b) У(Х) = Wy Xo = (0,0) 
(с) ЛХ) = TE, Xo = (0,0) 
4 2 „2 
(d) fX) = pcs Xo = (2,1) 
CE 1o s Se Ow 


(x + 2y + 4z)? ' 
Find limyx|.o0 / (X), if it exists. 
log(x? + 2y? + 422) 
(a) f(X) = a Т Уса 
х* = уе 


sin(x? + y?) 
/x? + y? 


(с) FX) = eet» (а) f(X) =e" 


(b) f(X) = 
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sin(x? — y?) 
(e) f(X) = x2—y2 "' EAE 

1, x= +y 
Define (a) limxj>vo f(X) = oo and (b) іх оо f(X) = —oo. 
Let 


|xil!|xa|? - -- [xn 19" 
X) = ——————————, 
fŒ xv 
For what nonnegative values of a1, a2, ..., Gn, b does limx.,9 f (X) exist in the 
extended reals? 
Let d 
g(X) = ру 
1 + хб y4 ш 


Show that Шт|х|—>со g(x, ax) = oo for any real number a. Does 


lim g(X) = оо? 


|X|oo 


For each f in Exercise 5.2.1, find the largest set S on which f is continuous or can 
be defined so as to be continuous. 


Repeat Exercise 5.2.9 for the functions in Exercise 5.2.5. 


Give an example of a function f on IR? such that f is not continuous at (0, 0), 
but f(0, y) is a continuous function of y on (—оо, оо) апа f(x, 0) is a continuous 
function of x on (—oo, оо). 


Prove Theorem 5.2.11. HINT: See the proof of Theorem 2.2.8. 
Prove Theorem 5.2.12. HINT: See the proof of Theorem 2.2.9. 
Prove Theorem 5.2.14. HINT: See the proof of Theorem 2.2.12. 


Suppose that X є D f C R" and Xisalimitpoint of D f. Show that f is continuous 
at X if and only if ітд f(Xx) = fX) whenever (X; is a sequence of points 


in D y such that limy.,o5 Хк = X. HINT: See the proof of Theorem 4.2.6. 


5.3 PARTIAL DERIVATIVES AND THE DIFFERENTIAL 


To say that a function of one variable has a derivative at xo is the same as to say that it 
is differentiable at хо. The situation is not so simple for a function f of more than one 
variable. First, there is no specific number that can be called the derivative of f at a point 
Xo in IR". In fact, there are infinitely many numbers, called the directional derivatives of 
f at Xo (defined below), that are analogous to the derivative of a function of one variable. 
Second, we will see that the existence of directional derivatives at Xo does not imply that f 
is differentiable at Xo, if differentiability at Xo is to imply (as it does for functions of one 
variable) that f(X)— f (Xo) can be approximated well near Xo by a simple linear function, 
or even that f is continuous at Xo. 
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We will now define directional derivatives and partial derivatives of functions of several 
variables. However, we will still have occasion to refer to derivatives of functions of one 
variable. We will call them ordinary derivatives when we wish to distinguish between them 
and the partial derivatives that we are about to define. 


Definition 5.3.1 Let ® be a unit vector and X a point in R". The directional derivative 
of f at X in the direction of is defined by 


OFX) _ us AZt D- ЛО) 

———— = lim ———————— 

д t>0 t 

if the limit exists. That is, 0f (X)/0® is the ordinary derivative of the function 
h(t) = f(X -- t) 

att = 0, if h’(0) exists. 

Example 5.3.1 Let ® = ($1, $2, фз) and 


f(x,y,z) 23xyz + 2x? + 22. 


Then 
h(t) = f(x + toi, у + 1фә, + t3). 
= 3(x + thi)(y + 1) + th3) + 2(x + tji + (с + 163)? 
and 
h' (t) = 31 (y + 1ф)(с + 1фз) + 392 (x + thi)(z + ths) 
+ 363(x + 1ф1)(у + tho) + 4Adi(x + th1) + 263 (z + (Q3). 
Therefore, 
200 = (0) = (Byz + 4х)фі + 3xzb2 + (3ху + 22)фз. (5.3.1) 
ш 


The directional derivatives that we are most interested in are those in the directions of 
the unit vectors 


E; = (1,0,...,0), E2=(0,1,0,...,0),..., E, =(0,...,0,1). 


(All components of E; are zero except for the ith, which is 1.) Since X and X + tE; differ 
only in the ith coordinate, 0f (X)/0E; is called the partial derivative of f with respect to 
x; at X. It is also denoted by 9//(X)/0x; or fx; (X); thus, 


df (X) 


0x1 = 


‚_ fer +t, x2,...,Xn) — Р(х, X2,..., Xn) 
X) = lim = 
Ja (X) = lim Т 
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00) - fX) = 1 im 2E Nip eed Xii aL et) One) 
"ы < n, and 
9f (X) gun Ee ез 


OXn = fen (X) = Í , 


if the limits exist. 


If we write X — (x, y), then we denote the partial derivatives accordingly; thus, 


POD) = б. уу са йй f(x +Һ,у)— f(x. y) 
Ox h—0 h 
and 
Of(x,y) _ ans SOY +A — fy) 
сша dye im — 


It can be seen from these definitions that to compute fx, (X) we simply differentiate f 
with respect to x; according to the rules for ordinary differentiation, while treating the other 
variables as constants. 


Example 5.3.2 Let 
f(x,y,z) = 3xyz + 2x? + 2? (5.3.2) 
as in Example 5.3.1. Taking Ф = Е; (that is, setting фу = 1 and фә = фз = 0) in (5.3.1), 


we find that 
9f(X) 97(Х) 
ox Е QE, 
which is the result obtained by regarding y and z as constants in (5.3.2) and taking the 
ordinary derivative with respect to x. Similarly, 


9f(X)  9f(X) 


= 3yz + 4x, 


“ai ie 
and 
af(X)  0f(X) 
= нараа 
Jz JE; idis и 


The next theorem follows from the rule just given for calculating partial derivatives. 


Theorem 5.3.2 І fx; (X) and gx, (X) exist, then 
9Cf + g)(X) 
OX; 


9Cfg)(X) 
m m 


= fx (X) + 8х; (Х), 


= fx; VX) + f(X)gx; (X). 
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and, if g(X) # 0, 
9Cf/g(X) | 8X) fs; (X) — f OO; (X) 
Ox; lœ] | 
If fx; (X) exists at every point of a set D, then it defines a function fy, on D. If this 
function has a partial derivative with respect to x; on a subset of D, we denote the partial 


derivative by 
9 (of 0? f 
(zz) Е Е 


Ox; дх; дх; 
Similarly, 
д 9? f E 0? f e 
Ox, кз © дхкдхудх — ахх: 
The function obtained by differentiating f successively with respect to x;,,Xj,,..., Xi, is 
denoted by T 


itis an rth-order partial derivative of f . 
Example 5.3.3 The function 
f (x,y) = 3x7 y? + xy 
has partial derivatives everywhere. Its first-order partial derivatives are 
f(x,y) = бху? b y, fyQ y) = 9x*y? +x. 


Its second-order partial derivatives are 


fax, y) = 6y3, fyy (x, у) = 18x?y, 
fey (x, у) = 18xy? +1, fyx(x, y) = 18xy? +1. 


There are eight third-order partial derivatives. Some examples are 
fxxy x, y) = 18y?, fxyx x, y) = 18y?, fyxx (x, y) = 18y?. 
Example 5.3.4 Compute f, (0, 0), fy, (0,0), £4, (0,0), and f, (0, 0) if 


(x?y + xy?) sin(x — y) 
ТО) eae o (x, y) # (0, 0), 


0, (x, y) = (0,0). 


Solution If (x, у) 4 (0,0), the ordinary rules for differentiation, applied separately to 
x and y, yield 


dieses Qxy + y?)sin(x — у) + (х?у + xy?) cos(x — y) 
x(x, y) = Е Ru ————— ет у? 


_2х(х?у + ху?) sin(x — y) 
(х2 + у2)2 , 


(5.3.3) 
(х,у) # (0, 0), 
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d 
i (х2 + 2xy)sin(x — y) — (x?y + xy?) сов(х — y) 
Jy t t) > z OOOO 
veu (5.3.4) 
2y(x?y + ху?) sin(x — y) i 
(aye (х,у) # (0,0). 


These formulas do not apply if (x, y) = (0, 0), so we find f, (0, 0) апа f, (0, 0) from their 
definitions as difference quotients: 


F&,0)— fO,0) _ 9-9. 


^0, ч) = р) X mm x =N 
0, y) — f (0,0 . 0-0 
(йг = im ЛО, у) – fO) im -— 
y0 y y0 y 


Setting y — 0 in (5.3.3) and (5.3.4) yields 


/[x(x.0) 20, fy(x,0)= sinx, x70, 


so 
fx (0,0) = lim fx. 0) — 0,0) — lim v=o =0, 
x0 x x>0 x 
,0) — fy (0,0 . sinx —0 
yx (0, 0) = lim J5 05,0) HOY ) Syl ) = шп BERN EUM E 1. 
х0 x x0 X 


Setting x — 0 in (5.3.3) and (5.3.4) yields 


fx(0, у) =—siny, f,(0,y) 20, y 40, 


SO 
0, y) — fx (0, 0 —siny —0 
miin ЕШ qu eMe La 
y0 y y0 y 
0, y) — f,(0,0 . 0-0 
ГО. = lim fy y) f ) = lim =0 и 
y0 y y0 y 


This example shows that f, (Xo) and fy, (Xo) may differ. However, the next theorem 
shows that they are equal if f satisfies a fairly mild condition. 


Theorem 5.3.3 Suppose that f, fx, fy, and fxy exist ona neighborhood N of (xo, yo). 
and fxy is continuous at (xo, yo). Then ух (хо, yo) exists, and 


fyx(X0, Yo) = Љу (Xo; yo). (5.3.5) 


Proof Suppose that є > 0. Choose 6 > 0 so that the open square 
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Ss = {(x, y) | |x — xol < 6, |y — yol < 8) 
is in № and 
| ху @®, 9) – fxy (Xo. Yo)| < € if (X,y)€ Ss. (5.3.6) 
This is possible because of the continuity of fxy at (xo, yo). The function 
A(h, k) = f(xo +h, yo + k) — f(xo + h, yo) — (хо, yo + К) + (хо, yo) (5.3.7) 
is defined if — < h, k < 5; moreover, 
A(h, k) = ф(хо + h) — $(xo). (5.3.8) 


where 
ф(х) = fx, yo +k) — f(x, yo). 
Since 
9 (x) = fsx, yo +k) — f(x. yo), Ix — xol < ô, 
(5.3.8) and the mean value theorem imply that 
Alh, k) = [f S, yo +k) — fe, yo)] h, (5.3.9) 


where X is between хо and хо +h. The mean value theorem, applied to f; (X, y) (where X 
is regarded as constant), also implies that 


fx GG yo +k) — fx (GG yo) = fry G.)k. 
where y is between yo and yo + k. From this and (5.3.9), 
Alh, k) = fs, GG. y)hk. 
Now (5.3.6) implies that 


A(h, К) 
hk 


= fxy (Xo. уо) = | fey 6,3) – fry (хо, yo)| «e if 0 < [|| « ô. 


(5.3.10) 
Since (5.3.7) implies that 


ji A(h,k) Ро +h, yo +k) — f(xo +h, yo) 
im ——— = lim ——_— ts 
k—0 hk k—0 hk 
. f (Xo. Yo + К) — f (xo. yo) 
= lim Â 
k—0 hk 
_ Љ (0 + h, yo) — fy Gro. yo) 
L8 


it follows from (5.3.10) that 


fy (Xo +h, уо) — fy (Xo. yo) 


p — fey (Xo. yo) x € if 0 < |А <6. 
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Taking the limit as Л — 0 yields 


| fyx(X0, Yo) — fxy (Xo. Yo)| < €. 


Since e is an arbitrary positive number, this proves (5.3.5). ш 


Theorem 5.3.3 implies the following theorem. We leave the proof to you (Exercises 5.3.10 
and 5.3.11). 


Theorem 5.3.4 Suppose that f and all its partial derivatives of order < т are contin- 
uous on an open subset S of К”. Then 


fx xin - x (X) = fx jx pe x (X) Хє $, (5.3.11) 
if each of the variables x1, x2, ..., Xn appears the same number of times in 
ФО РАС, Н апа xii Xp sees Xj} 


If this number is ry, we denote the common value of the two sides of (5.3.11) by 


9" f(X) 


Жтт дтп, 5.3.12 
0x1 0x5 +++ дхи" ( ) 
it being understood that 
O<r<r, 1<k<n, (5.3.13) 
rı + + + Гл = Р, (5.3.14) 


and, if ry = 0, we omit the symbol gat from the "denominator" of (5.3.12). 


For example, if f satisfies the hypotheses of Theorem 5.3.4 with k = 4 at a point Xo in 
IR" (n > 2), then 


fxxyy (Хо) = Руху (Xo) = /хуух (Xo) = Јуухх(Хо) = Јухух(Хо) = Јухху (Хо), 
and their common value is denoted by 


д f (Xo) 
0x20y2 ` 


It can be shown (Exercise 5.3.12) that if f is a function of (x1, x2, ..., Xn) and (r1, r2, .. . , Fn) 
is a fixed ordered n-tuple that satisfies (5.3.13) and (5.3.14), then the number of partial 
derivatives fei, Xin Xi that involve differentiation r; times with respect to x;, 1 <i <n, 
equals the multinomial coefficient 


r! 


IAN 
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Differentiable Functions of Several Variables 


A function of several variables may have first-order partial derivatives at a point Xo but fail 
to be continuous at Xo. For example, if 


xy 


Дх, у) = x* + y? кл (5.3.15) 
0, (х, y) = (0, 0), 
Шеп 
ou /@0—/0,0 0-0_ 
BINE "uut 
and 
E fO, 700,0)... 0-0 . 


but f is not continous at (0, 0). (See Examples 5.2.3 and 5.2.11.) Therefore, if differentia- 
bility of a function of several variables is to be a stronger property than continuity, as it is 
for functions of one variable, the definition of differentiability must require more than the 
existence of first partial derivatives. Exercise 2.3.1 characterizes differentiability of a func- 
tion f of one variable in a way that suggests the proper generalization: f is differentiable 


at xo if and only if 
imn LOX = Lo) = mx = x0) _ 


x—XQ X — Xo 


0 


for some constant m, in which case m = /'(хо). 


The generalization to functions of n variables is as follows. 
Definition 5.3.5 A function f is differentiable at 


Xo = (X10, Х20,..., Хпо)) 


if X9 € D^ and there are constants 71, M2, ..., Mn such that 


f (X) — f(Xo) - 2 mj (x; — Xio) 


lim ———— — —L— 2 —— ———— - 0. 5.3.16 
х, [X — Xo| ( ) 


Example 5.3.5 Let 
f(x. y) = x? + 2xy. 


We will show that f is differentiable at any point (xo, yo), as follows: 
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f(x, y) — f (Xo, yo) = x? + 2xy — хд — 2xoyo 
= х?— a + 2(xy — xoyo) 
= (x — хо)(х + xo) + 2(xy — хоу) + 2(xoy — Xoyo) 
= (x + xo + 2y)(x — xo) + 2xo(y — yo) 
= 2(xo + yo)(x — xo) + 2xo(y — yo) 
+ (x — хо)(х — xo + 2y — 2yo) 
= mi(x — xo) + ma(y — yo) + (x — xo)(x — xo + 2y — 2yo). 
where 
mı = 2(xo + yo) = fx(Xo. yo) and mz = 2х0 = fy(xo. yo). (5.3.17) 
Therefore, 


| fC, y) — f (Xo. Yo) — mi = xo) — ma(y — уо)| _ Ix — xoll@ — xo) + 20 — у0)| 
[X — Xo| [X — Xo| 


< V5|X — Xol, 
by Schwarz’s inequality. This implies that 


j f(x,y) — f (xo. yo) — mı (x — xo) — mo(y — yo) _ 
wa - 


0, 
X—>Xo IX = Xo| 


so f is differentiable at (xo, yo). a 


From (5.3.17), mı = /fx(Xo. yo) and m5 = /fy(xo. yo) in Example 5.3.5. The next 
theorem shows that this is not a coincidence. 


Theorem 5.3.6 If f is differentiable at Хо = (x10. X20. .... Хпо), then fx, (Хо), 
fx; (Xo). ..., fx, (Хо) exist and the constants mı, m2, ..., Mn in (5.3.16) are given by 


mi = №. (Хо), 1<ї<п; (5.3.18) 
that is, 


f(X) — f (Xo) — У f Ko) (xi — xio) 


lim ————————— LL =o. 
X—Xo IX = Xo| 


Proof Leti bea given integer in {1,2,...,}. Let X = Xo + tE;, so that x; = xio +t, 
xj = xjoif j Ai, and |X — Xo| = |t|. Then (5.3.16) and the differentiability of f at Xo 
imply that 

lim f (Xo + tE;) — f Xo) — mit 


t>0 t 


=0. 
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Hence, 
. f (Xo + tE;) — f (Xo) 
lim ————————————— = m 
10 t 
This proves (5.3.18), since the limit on the left is fx; (Xo), by definition. [| 


A linear function is a function of the form 
L(X) = mix + maxa +++ тах, (5.3.19) 


where m, M2, ..., Mn are constants. From Definition 5.3.5, f is differentiable at Xo if 
and only if there is a linear function L such that f(X) — f(Xo) can be approximated so 
well near Xo by 

LX) — L(Xo) = LX — Xo) 


that 
РОХ) — f(Xo) = L(X — Xo) + E(X)(|X — Xo], (5.3.20) 

where 
yim E(X) = 0. (5.3.21) 


Theorem 5.3.7 If f is differentiable at Xo, then f is continuous at Xo. 


Proof From (5.3.19) and Schwarz's inequality, 
|L(X — Xo)| < MIX — Xo], 


where 
M= (m2 + m2 + +--+ m2), 


This and (5.3.20) imply that 
| f(X) — f(Xo)| < (М + |E(X)|)[X — Xol, 


which, with (5.3.21), implies that f is continuous at Xo. E 


Theorem 5.3.7 implies that the function f defined by (5.3.15) is not differentiable at 
(0,0), since it is not continuous at (0,0). However, fx(0,0) and } (0, 0) exist, so the 
converse of Theorem 5.3.7 is false; that is, a function may have partial derivatives at a 
point without being differentiable at the point. 


The Differential 


Theorem 5.3.7 implies that if f is differentiable at Xo, then there is exactly one linear 
function L that satisfies (5.3.20) and (5.3.21): 


LX) = fx (Хо) + fx; (Хо) +++ + fren (Xo)xn. 
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This function is called the differential of f at Хо. We will denote it by dx, f and its 
value by (dx, f)(X); thus, 


(dxo f (X) = fx, (Хо) + fx; (Xo)xa + +++ fxn (Xo) Xn- (5.3.22) 


In terms of the differential, (5.3.16) can be rewritten as 


fam 00 = fKo) = dx, X — Xo) _ 
m — ——-————= 


0. 
X—>Xo [X — Xo| 


For convenience in writing dx, f, and to conform with standard notation, we introduce 
the function dx;, defined by 
ах; (X) = Xi; 


that is, dx; is the function whose value at a point in IR" is the ith coordinate of the point. It 
is the differential of the function g; (X) — x;. From (5.3.22), 


dxo f = fx (Xo) dxi + fx, (Xo dx2 + +++ + fxn (Хо) dxn- (5.3.23) 
If we write X = (x, y, ...,), then we write 
dx, f = fx(Xo) dx + fy(Xo) dy +, 
where dx, dy, ... are the functions defined by 
dx(X)— x, dy(X) = у,... 


When it is not necessary to emphasize the specific point Xo, (5.3.23) can be written more 
simply as 


df = fx, dx + fx, dx2 +--+ fxn dXn. 


When dealing with a specific function at an arbitrary point of its domain, we may use the 
hybrid notation 


df = fx, (X) dxi + fx, (X) ао +++ fx, (X) хп. 
Example 5.3.6 We saw in Example 5.3.5 that the function 
Јоу) = х? + 2xy 
is differentiable at every X in R”, with differential 
df = (2x + 2y)dx + 2x dy. 
To find dx, f with Xo = (1, 2), we set хо = 1 and yo = 2; thus, 


dx, f =6dx+2dy 


and 
(dx, f (X — Xo) = 6(x — 1) + 2(y — 2). 
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Since f(1, 2) = 5, the differentiability of f at (1, 2) implies that 
Fy) —5— 6% -10-20-2 _ 9 


lim 
(x,y)>(1,2) V(x = 1)? + (y = 2)? 


Example 5.3.7 The differential of a function f = f(x) of one variable is given by 


dxo = f'(xo) dx, 
where dx is the identity function; that is, 
dx(t) — t. 
For example, if 
f(x) = 3x? + 5x3, 


then 
df = (6x + 15x?) dx. 


If xo = —1, then 
dxo f = 9dx, (dxo f )(x = хо) = 9(х + 1), 
and, since f(—1) = —2, 


ji f(x) + 2— 9(x + 1) 
im —————————— = 


0. " 
x—-—1 x+1 


Unfortunately, the notation for the differential is so complicated that it obscures the 
simplicity of the concept. The peculiar symbols df, dx, dy, etc., were introduced in 
the early stages of the development of calculus to represent very small (“infinitesimal”) 
increments in the variables. However, in modern usage they are not quantities at all, but 


linear functions. This meaning of the symbol dx differs from its meaning in f i f(x)dx, 
where it serves merely to identify the variable of integration; indeed, some authors omit it 


s : А b 
in the latter context and write simply f. 5 


Theorem 5.3.7 implies the following lemma, which is analogous to Lemma 2.3.2. We 
leave the proof to you (Exercise 5.3.13). 


Lemma 5.3.8 If f is differentiable at Xo, then 
fX) — f(Xo) = (dx, f (X — Xo) + E(X)IX — Xol, 
where E is defined in a neighborhood of Xo and 
ed E(X) = E(Xo) = 0. 


Theorems 5.3.2 and 5.3.7 and the definition of the differential imply the following 
theorem. 
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Theorem 5.3.9 /f f and g are differentiable at Xo, then so are f + g and fg. The 
same is true of f /g if g(Xo) 5+ 0. The differentials are given by 


4х Cf + g) = dxo f + dx, 
dxo (fg) = f(Xo)dxog + g(Xo)dx, f. 


d (2) _ £(Xo)dx, f — f Xo)dxog 
Xo. = Re 
ё [g(Xo)P 


and 


The next theorem provides a widely applicable sufficient condition for differentiability. 


Theorem 5.3.10 If fxi, f. .... fxn exist on a neighborhood of Xo and are contin- 
uous at Xo, then f is differentiable at Xo. 


Proof Let Xo = (x19. X20,...,Xno) and suppose that є > 0. Our assumptions imply 
that there is a ô > 0 such that fxi, fi.,..., fxn are defined in the n-ball 


Ss (Xo) = {X | |X — Хо < ô} 


and 
|/x; (X) — fx; (Xo) «e if |[X—Xog| <6, 1x j zn. (5.3.24) 


Let X = (x1, x,..., Xn) bein Ss(Xo). Define 
Xj = (X1,..., Xj, Xj+1,0, so Хо), 1xjzn-1l, 


and X, = X. Thus, for 1 < j < n, X; differs from Хуу in the jth component only, and 
the line segment from X;.., to X; is in Ss (Хо). Now write 


F(X) – f(Xo) = f/(X4) – f(Xo) = M LF (Ks) - f(Xj-1)]. (5.3.25) 
Ј=1 
and consider the auxiliary functions 
git) = f(t, x20,.--,Xno), 
230) = f(x1,....Xj-1,.t,Xj41,0.---,Xno); 2<j <n-l, (5.3.26) 
ga(t) = f... Xni. f), 


where, in each case, all variables except t are temporarily regarded as constants. Since 
f(Xj) - f(Xj-1) = 8j (xj) — 8j(x5o). 
the mean value theorem implies that 


fX) - f(Xj-1) = ву(ту)(ху — хло), 
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where ту is between x; and x jo. From (5.3.26), 
80у) = fa; (Xj). 
where X; is on the line segment from X;_; to X;. Therefore, 


SAD- fa) = f RE хло), 
and (5.3.25) implies that 


F(X) – Хо) = Y fe; (€); —xjo) 


j=l 
=} fe; Ko)(xj — хуо) + Y, D; 6) — f KE — хо). 
Ј=1 Ј=1 


From this and (5.3.24), 


n n 
F(X) — f (Xo) - У fr; (Xo)(x; хо) S € Y lx — xjo| < пє|Х — Xo. 
j=l j=l 
which implies that f is differentiable at Xo. E 


We say that f is continuously differentiable on a subset S of R” if S is contained in an 
open set on which fyi, Љо, ·.., fx, are continuous. Theorem 5.3.10 implies that such a 
function is differentiable at each Xo in S. 


Example 5.3.8 If 

x24 у? 

fœ y) = ——, 

x—y 
then 
2x х? + у? 2у x? + у? 
— — —— and fbx, y) = —— + ————. 
х-у (х—у)? ” х-у (х-у)? 


Since f, and f, are continuous on 


S = {(x,y)|x Æ y} 


f is continuously differentiable on S. 


fx, y) = 


Example 5.3.9 The conditions of Theorem 5.3.10 are not necessary for differentiabil- 
ity; that is, a function may be differentiable at a point Xo even if its first partial derivatives 
are not continuous at Хо. For example, let 


1 
x = у)? sin E: А 
iape (x — y) PT + у 
0, х = у. 
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Then | 
Ax (x, у) = 2(x — у) sin — cos , xy, 
х= у х= у 
апа 2 
2 f(xch,x)— Р(х, х) .  h^sin(1/ 1) – 0 
x(x, x) = lim ———————— = lim ————— — —— = 0, 
© x) [=ч h uv h ? 


so fy exists for all (x, y), but is not continuous on the line y = x. The same is true of fy, 
since 


1 
Sy(x, у) = —2(х — у) sin pm x Xy, 


x—y 
and 7 
ac SOPH Ta) s К°вї(—1/К)—0 _ 
EE пиш EL ge d 
Now, 
у 
fæ у) F00- /, (0, бух — 00.0) _ AGI xy 
А dye caes pucr ЗА У TOI Eee „. = = 
yx? T y2 0, х = у, 


апа Schwarz’s inequality implies that 


Оа _1 | 2 EE) 


Мату? x» уату? 


=2үх? +у2, ху. 


Therefore, 


im £093 — 700.0) — £0, 0x — frO.Oy _ 
(х,у) (0,0) Vx? + y? 


so f is differentiable at (0, 0), but f and fy are not continuous at (0, 0). 


0, 


Geometric Interpretation of Differentiability 


In Section 2.3 we saw that if a function f of one variable is differentiable at xo, then the 
curve y = f(x) has a tangent line 


y = T(x) = f(xo) + f'(xo)(x — xo) 
that approximates it so well near xo that 


T JOD. 
im —————— = 


х->хо X — Xo 


0. 


Moreover, the tangent line is the “limit” of the secant line through the points (x1, f (xo)) 
and (xo, f'(xo)) as x1 approaches хо. 
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2 


Figure 5.3.1 


Differentiability of a function of n variables has an analogous geometric interpretation. 
We will illustrate it for n = 2. If f is defined in a region D in В2, then the set of points 
(x, y, z) such that 

z= f(x,y), (х,у) єр, (5.3.27) 


is a surface in R? (Figure 5.3.1). 


Figure 5.3.2 


If f is differentiable at X9 = (xo, yo), then the plane 
z = T(x, у) = f(Xo) + fx(Xo)(x — хо) + fy(Xo)(y — yo) (5.3.28) 


intersects the surface (5.3.27) at (хо, уо, f (хо, yo)) and approximates the surface so well 
near (xo, yo) that 


332 Chapter 5 Real- Valued Functions of Several Variables 


lim fœ y) -Tœ y)  — 
Gy) (хоро) y(x — xo)? + (y — yo)” 
(Figure 5.3.2). Moreover, (5.3.28) is the only plane in IR? with these properties (Exer- 
cise 5.3.25). We say that this plane is tangent to the surface z = f(x,y) at the point 
(хо, уо, f (хо, yo)). We will now show that it is the “limit” of "secant planes" associated 
with the surface z = f(x, y), just as a tangent line to a curve у = f(x) in R? is the limit 
of secant lines to the curve (Section 2.3). 


Let X; = (xi, yi) (i = 1,2,3). The equation of the “secant plane" through the points 
(xi, yi, f Ga. yi)) @ = 1,2,3) on the surface z = f(x, y) (Figure 5.3.3) is of the form 


z = f(Xo) + A(x — xo) + BO — yo), (5.3.29) 
where A and B satisfy the system 


f (X1) = f(Xo) + А(х — xo) + В(у1 — yo). 
f (X3) = f(Xo) + A(x2 — xo) + B(ya — yo). 


Solving for A and B yields 
_ ОХ) — f (Xo) Qa — yo) — C/(X2) – f(Xo)) i — yo) 


à (x1 — xo)(y2 — yo) — (х2 — хо)(у1 — yo) RM 
and 
B= X2) — f(Xo))o — xo) – (F(K1) — f(Xo)) (xa — xo) (5.3.31) 
(x1 = хо)(у2 — Yo) — (х2 — xo)O1 — yo) 
if 
(x1 — хо)(у2 — yo) — (x2 — xo)O — Yo) # 0, (5.3.32) 


which is equivalent to the requirement that Xo, Х|, and Xz do not lie on a line (Exer- 
cise 5.3.23). If we write 


X; = Xo +tU and Х = Xo - fV, 


where U = (ui,u2) and V = (vi, v2) are fixed nonzero vectors (Figure 5.3.3), then 
(5.3.30), (5.3.31), and (5.3.32) take the more convenient forms 


f (Xo + tU) =). _ f(X%o + гу) zT 


йе ——— — (5.3.33) 
Wu1U5 — U21 


f(Xo + (V) — fO, |f (Xo + 1U) 0000. 


— —————— ——., (5.3.34) 
u1U5 — u5U| 


and 
иі) —U2v, Æ 0. 
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A 


Figure 5.3.3 


If f is differentiable at Xo, then 


F(X) — (Хо) = fx(Xo)(x — xo) + fy (X0)(y — yo) + €(X)|X — Xo], (5.3.35) 


where 
lim є(Х) = 0. (5.3.36) 
xX— Xo 


Substituting first X = Хо + tU and then X = Хо + tV in (5.3.35) and dividing by t yields 


f (Xo + tU) — f (Xo) 


i = fr(Xo)ur + fy(Xo)u» + Ei(t)|U| (5.3.37) 
and е У т 
tV) — 
мс н = fx(Xo)ui + fy(Ko)v2 + Ex(t)|VI. (5.3.38) 
where 
E(t) = «(Хо + tU)|t|/t and E(t) = «(Хо + tV)|t|/t, 
so 


lim Ej(t) 20, i =1,2, (5.3.39) 

t> 

because of (5.3.36). Substituting (5.3.37) and (5.3.38) into (5.3.33) and (5.3.34) yields 
A= fx(Xo) + Ai(@), B= fy(Xo) + 420), (5.3.40) 


where 
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v2|U| E (t) — u2|V| Ez (t) 


Ai) = 
uy ,v2 — u5U1 
is VIE UJE 
t)— t 
At) = 2! |E2(t) — vı |U] 10) 
uy ,v2 = Чат 
50 
lim Д; (0) = 0, = 1,2, (5.3.41) 
t> 


because of (5.3.39). 
From (5.3.29) and (5.3.40), the equation of the secant plane is 


z = f(Xo) + [fr (Xo) + A1(0)](x — xo) + [fy (Xo) + Az()]G — yo). 


Therefore, because of (5.3.41), the secant plane “approaches” the tangent plane (5.3.28) as 
t approaches zero. 


Maxima and Minima 

We say that Xo is a local extreme point of f if there is a д > 0 such that 
F(X) — f(Xo) 

does not change sign in Ss (Xo) N D y. More specifically, Xo is a local maximum point if 
SX) € f(Xo) 


or a local minimum point if 
F(X) = f(Xo) 
for all X in $5(X9) П D y. 


The next theorem is analogous to Theorem 2.3.7. 


Theorem 5.3.11 Suppose that f is defined in a neighborhood of Xo in R” and fx, (Xo), 
fx; (Xo), ..., fx, (Xo) exist. Let Xo be a local extreme point of f. Then 


fx; (Хо) =0, Ixi zn. (5.3.42) 
Proof Let 
E; = (1,0,...,0), Ez = (0,1,0,...,0),..., Е, = (0,0,...,1), 


апа 
gi(t) = f(Xo +tE;), 151 <и. 


Then g; is differentiable at t = 0, with 


gi (0) — fx (Xo) 
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(Definition 5.3.1). Since Xo is a local extreme point of f, ty = 0 is a local extreme point 
of gi. Now Theorem 2.3.7 implies that g/(0) = 0, and this implies (5.3.42). ш 


The converse of Theorem 5.3.11 is false, since (5.3.42) may hold at a point Xo that is 
not a local extreme point of f. For example, let Хо = (0, 0) and 


fœ, y) = x? +y’. 


We say that a point Хо where (5.3.42) holds is a critical point of f. Thus, if f is defined 
in a neighborhood of a local extreme point Xo, then Xo is a critical point of f; however, a 
critical point need not be a local extreme point of f. 


The use of Theorem 5.3.11 for finding local extreme points is covered in calculus, so we 
will not pursue it here. 


5.3 Exercises 


1. Calculate df (X)/0®. 


(a) f(x,y) = х? + 2хусоѕх, Ф = (5-45) 
1 


(b) f(x.y.z) = ett, Фф = (= _ 


1 1 1 
(с) f(X) = |X}, e= (= a) 
(d) f(x, y,z) = 108(1+х+у +2), Ф = (0,1,0) 
2. Let . 
xy sinx 
fene eg COCO 
0, (x, y) = (0,0), 


and let ® = (1, %2) be a unit vector. Find ðf (0, 0)/06. 

3. Find ðf (Xo)/0®, where Ф is the unit vector in the direction of X; — X). 
(a) fG.y.z)—sinzxyz; Xo = (1,1,-2), Х =(3,2,—1) 
(b) f(x.y.z)2e-C7*»^*?29: X9—(1,0,—1, X12 Q,0,—1) 
(c) f(x,y,z) =log+x+y+z); Хо = (1,0,1), Xi = (3,0, –1) 
(d) ŒX) = |Х|*; Хо= 0, Xi- (1,1,...,1) 


4. Give a geometrical interpretation of the directional derivative 3f (хо, уо)/0Ф of a 
function of two variables. 


5. Find all first-order partial derivatives. 
(a) f(x, y,z) = logx + y + 22) (b) fG у, 2) = x? + 3xyz  2xy 


(с) f(x, y, 2) = xe” (d) f(x, y. z) =z + sinx?y 
6.  Findall second-order partial derivatives of the functions in Exercise 5.3.5. 
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7. 


10. 


11. 
12. 


13. 


Find all second-order partial derivatives of the following functions at (0, 0). 


ху(х? — y? 
(а) Jepe ery 09209 09, 
0, (x, y) = (0,0) 
зоне att 
(b) f(x,y) = кын x уар y xz0, y #0, 
0, x=0 or y=0 


(Неге | tan! u| < 2/2.) 
Find a function f = f(x,y) such that fxy exists for all (x, y), but fy exists 
nowhere. 


Let и and v be functions of two variables with continuous second-order partial 
derivatives in a region S. Suppose that и; = vy and uy = —vy in 5. Show 
that 

Uxx + Uyy = Uxx + уу = 0 
in S. 
Let f be a function of (x1, x2, ..., Xn) (n = 2) such that fx;, fx; and fx;x; (i A 
j) exist on a neighborhood of Xo and fx; xj is continuous at Хо. Use Theorem 5.3.3 
to prove that fx ; x; (Xo) exists and equals fx; х, (Xo). 
Use Exercise 5.3.10 and induction on r to prove Theorem 5.3.4. 


Let r1, r2. ..., ry be nonnegative integers such that 
тү crar =т > 0. 
(a) Show that 


r! rı „r2 


(cr z2ceeiy- Z4 X Uns. 


Ir5! pu! 
E Түү Fn: 


where ae denotes summation over all n-tuples (71,72,...,/) that satisfy 
the stated conditions. HINT: This is obvious ifn = 1, and it follows from 
Exercise 1.2.19 ifn = 2. Use induction on п. 


(b) Show that there are 
r! 


TiIr3! ry! 
ordered n-tuples of integers (74,15, ..., i4) that contain rı ones, r2 twos, ..., 
and rp n's. 
(c) Let f bea function of (x1, х2,..., Xn). Show that there are 


r! 
ri!r2! Р! 


partial derivatives fei, Xin 
to xj, fori =1,2,...,n. 


эх that involve differentiation r; times with respect 


Prove Lemma 5.3.8. 


14. 


15. 


16. 


17. 


18. 


19. 


20. 


21. 
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Show that the function 


x?y 
оу) = { xry NF (00), 
0, (x, y) = (0,0), 


has а directional derivative in the direction of an arbitrary unit vector Ф at (0, 0), but 

f is not continuous at (0, 0). 

Prove: If fy and f, are bounded in a neighborhood of (xo, yo), then f is continuous 

at (xo, yo). 

Show directly from Definition 5.3.5 that f is differentiable at Xo. 

(а) f(x,y) = 2x? + 3xy c y?, Xo = (1,2) 

(b) f(x, у, 2) = 2х2 + 3х + 42, Хо = (1,1,1) 

(c) f(X) =|X|?, Xo arbitrary 

Suppose that f, exists on a neighborhood of (xo, yo) and is continuous at (xo, уо), 

while f, merely exists at (хо, yo). Show that f is differentiable at (хо, yo). 

Find df and dx, Ў, and write (dx, f)(K — Xo). 

(а) f(x,y) = х? + 4ху2 + 2xysinx, Xo = (0,—2) 

(b) fx, у, z) = e Ct»t2), Xo = (0, 0, 0) 

(c) f(X) = log(l + xi + 2x2 + 3x3 nx) Хо=0 

(d) fX —|X", Xo = (1,1,1,...,1) 

(a) Suppose that f is differentiable at Xo and Ф = (ф1, фә,..., фл) is a unit 
vector. Show that 


9f (Xo) 
дФ 


= fu (Xo)¢1 EN to (Xo )o2 кер Ton (Хо)фһ. 


(b) For what unit vector Ф does 3f (Хо)/дФ attain its maximum value? 
Let f be defined on R” by 


РОХ) = g(x1) + 8x2) +- + Bn), 
where і 
u?sin—, и #0, 
u 
; и = 0. 


Show that f is differentiable at (0, 0,..., 0), but fxi, А, ..., fx, are all discon- 
tinuous at (0,0,...,0). 


gu) = 


The purpose of this exercise is to show that if f, fx and fy exist on a neighborhood 
N of (хо, yo) and fy and f, are differentiable at (хо, yo), then fxy(xo, yo) = 
Јух (хо, yo). Suppose that the open square 


(О, у) | lx — xol < ||, Ly — yol < lhl} 
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22. 


23. 


24. 


is in №. Consider 


B(h) = f(xo + h, yo +h) — f(xo + h, yo) — f (хо, yo + h) + f (xo. yo). 


(a) Use the mean value theorem as we did in the proof of Theorem 5.3.3 to write 


B(h) = [fx (©, yo + k) — fe (€. yo)] h. 


where X is between xo and xo + A. Then use the differentiability of fy at 
(хо, yo) to infer that 


Eı(h) = 


0. 
h 


B(h) = h*T.y iis yo) + РЕ (л), where un 
—0 


(b) Use the mean value theorem to write 


B(h) = [f Gro +h, 9) — fy Gro. Ў)] h. 


where y is between yo and уо + h. Then use the differentiability of / at 
(xo, yo) to infer that 


E»x(h 
B(h) — h? fyx(x0, yo) + hE2(h), where lim cael) = 
—0 


0. 
(c) Infer from (a) and (b) that fx, (хо, yo) = fyx(xo. yo). 


(a) Let f; and fy, be differentiable at a point Xo in R”. Show from Exer- 
cise 5.3.21 that 


Рх; (Xo) = Рух (Хо). 


(b) Use (a) and induction on г to show that all (r — 1)-st order partial derivatives 
of f are differentiable on an open subset S of R”, then tei, xxi, (X) (X є 5) 
depends only on the number of differentiations with respect to each variable, 
and not on the order in which they are performed. 


Prove that (xo, уо), (x1, уз), and (x2, y2) lie on a line if and only if 
(x1 — хо)(у2 — Yo) — (х2 — xo)On — Yo) = 0. 
Find the equation of the tangent plane to the surface 
z= f(x,y) at (хо, уо, 20) = (хо, yo. f (Xo. yo)). 


(a) fœ, y) =x? +y?-1, (хо, уо) = (1,2) 

(b) f(x,y) = 2х + 3у +1, (хо, уо) = (1,—1) 
(c) fœ, у) = xysinxy, (хо, yo) = (1, 2/2) 

(d) f(x,y) = х2 2у2 +3xy, (хо, уо)  Q.-1) 
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25. Prove: If f is differentiable at (xo, yo) and 


j fœ, y)-a-b(x — хо) – с(у – Yo) _ 
im = 


(х,у) -(хо,уо) у(х — xo)? + (y — yo)” 


thena = f(xo, yo), b = fx(xo. yo), and с = fy (хо, yo). 


0, 


5.4 THE CHAIN RULE AND TAYLOR’S THEOREM 


We now consider the problem of differentiating a composite function 
h(U) = f(G(U)). 


where G = (01, 82,.--,n) 15 a vector-valued function, as defined in Section 5.2. We 
begin with the following definition. 


Definition 5.4.1 A vector-valued function G = (g1, g2,..., Zn) is differentiable at 
Uo = (ио, u20, . . . , Umo) 


if its component functions g1, g2,..., Zn are differentiable at Оо. ш 
We need the following lemma to prove the main result of the section. 


Lemma 5.4.2 Suppose that G = (g1, g2,..-, n) is differentiable at 
Uo = (u10, u20. .. Ито), 


and define 


Then, if € > 0, there isa ô > 0 such that 


IG(U) — G(Uo)| 


«M if 0«|U—Uo| <ô. 
UU] +e if | ol 


Proof Since gi, 22,..., Zn are differentiable at Uo, applying Lemma 5.3.8 to g; shows 
that 
£i (U) — gi (Uo) = (duo8i)(U — Uo) + E; (U)|(U — О] 


"9g; (U 54.1 
= A Den, — ujo) + Ej(U)(U — Uol, Bo» 
J 


Ј=1 
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where 
lim £;(U)=0, 1l<i<n. (5.4.2) 
U—Uo 


From Schwarz's inequality, 


|g: (U) — gi (Uo)| < (М; + | Ej (U))|U — Ue], 


where ij 
М, = e^ f 8gi(Uo) V 
i 2: sus 
j=l i 
Therefore, 
IG - GUI. [г Е 
= B 2 
< М; + |Ej(U А 
UEA (> i say 
From (5.4.2), 
" 1/2 " 1/2 
M (Se + мо) - (Y: м) = М, 
e G= ici 
which implies the conclusion. E 


The following theorem is analogous to Theorem 2.3.5. 


Theorem 5.4.3 (The Chain Rule) Suppose that the real-valued function f is 
differentiable at Xo in R” , the vector-valued function G = (g1, 82, . . . , gn) is differentiable 
at Uo in IR", and X9 = G(Uo). Then the real-valued composite functionh = f об defined 
by 

h(U) = f(G(U) (5.4.3) 


is differentiable at Uo, and 
duoh = fu (Xo)dv, 21 F № (Xo)dv, 22 speseq- Fen (Xo) dup gn. (5.4.4) 


Proof We leave it to you to show that Up is an interior point of the domain of h (Exer- 
cise 5.4.1), so it is legitimate to ask if Л is differentiable at Ug. 


Let Xo = (X10, X20, ---, X590). Note that 
xio—gi(Uo) 1<i<n, 


by assumption. Since f is differentiable at Xo, Lemma 5.3.8 implies that 


F(X) — f (Xo) = У fa Ko) (xi — xio) + E(X)IX — Xol, (5.4.5) 


i=1 


where 
lim E(X) = 0. 
X— Xo 
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Substituting X = G(U) and Хо = G(Up) in (5.4.5) and recalling (5.4.3) yields 


h(U) — h(Uo) = У fs: (Xo) (ei (О) — gi (Uo)) + E(G(U)|G(U) —GUo)|. (5.4.6) 


i=1 


Substituting (5.4.1) into (5.4.6) yields 


h(U) — h(Uo) = } ` fx; Ko) (duo gi)(U — Uo) + (Y: А, (Xo) Ei v) |U — Uo| 
i=1 i=1 
+E(G(U))|GU) — GU). 
Since 
lim, EGO) = lim E(X) = 0. 


(5.4.2) and Lemma 5.4.2 imply that 


h(U) — h(Uo) — У fx: Kodugi(U — Uo) 


= = 0. 
|U — Uo| 


Therefore, h is differentiable at Ug, and dugh is given by (5.4.4). ш 
Example 5.4.1 Let 
f(x, y, z) = 2x? + 4ху + 3yz, 


gi(u,v) = ur + v?, g2(u, v) = и? — 212, g3(u,v) = uv, 


апа 
h(u,v) = /(в1(и,®), g2(u, v), g3(u, v)). 
Let Up = (1, —1) and 


Xo = (gı (Uo), £2(Uo). g3(Uo)) = Q.—1, —1). 


Then 
fx(Xo) 24, f,(Xo9)—-5, f;(Xo)—-3, 
8g1(Uo) — 2, 0g1(Uo) zh 
Qu дъ 
д82(00) — 2 дез» (Со) _ 
ди i Qv | 
dg3(Uo) _ E dg3(Uo) _ 1 
ди др 
Therefore, 


Яро —2du—2dv, рә —2du--4dv, арз = —du + dv, 
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and, from (5.4.4), 
duoh = fx(Xo) dup 81 + fy (Xo) dup 82 + fz (Хо) duo 83 
= 4(2du—2dv)+5(2du+4 4dv) — 3(—du + dv) 
= 21 du + 9 dv. 


Since 
duh = hu (Uo) du + h, (Uo) dv 


we conclude that 
hy(Up) = 21 and h,(Uo) = 9. (5.4.7) 


This can also be obtained by writing h explicitly in terms of (u, v) and differentiating; thus, 
h(u, v) = 2[g1 (u, 0)] + 4g1 (u, v)go Qu, v) + 3g2(u, ъ)аз(и, v) 
= 2(u? + 02)? + 4(и2 + v?) (u? — 2v?) + 3(V? — 2v?)uv 
= би“ + 3u3v — 6uv? — 6v*. 
Hence, 
hy (u,v) = 24u? + 9u?v — 6v? апі h,(u, v) = 34? — 18uv? — 240°, 
so A, (1, —1) = 21 and A, (1, —1) = 9, consistent with (5.4.7). 


Corollary 5.4.4 Under the assumptions of Theorem 5.4.3, 


dh(Uo) “. af (Xo) 8g ; (Uo) ; 
= И Я А. 
ди; 2, дх; ды; ^C Spem (5.4.8) 
Proof Substituting 
д8; i i ; 
diis gi (Uo) P дв: (Uo) Bi tig dgi(Uo) du Ie 
Qui u дит 


into (5.4.4) and collecting multipliers of du;, du», ..., dum yields 


doh = У 3 df (Xo) 02; (Uo) Дш. 


Ox; ди; 


і=1 \j=1 


However, from Theorem 5.3.6, 


1 


duh — x La dui. 


i=1 


Comparing the last two equations yields (5.4.8). ш 
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When it is not important to emphasize the particular point Xo, we write (5.4.8) less 
formally as 


<m, (5.4.9) 


oh of дву 
ди; 23 10x; ди;` 


with the understanding that in кин dh(Uo)/du;, 0g;/0uj is evaluated at Up and 
0f/0x; at Xy = G(Up). 
The formulas (5.4.8) and (5.4.9) can also be simplified by replacing the symbol G with 
X = X(U); then we write 
h(U) = f(X(U)) 


and 
дА (Uo) Imm df (Xo) 0x; (Uo) 
ди; 0x; Ou; 
or simply 
oh is Of dx; 
m— == —— —. 4.1 
ди; L Ox; ди; Ө 2 


Example 5.4.2 Let (r, 0) be polar coordinates in the x y-plane; that is, 
x=rcos#, y=rsinð. 

Suppose that f = f(x, y) is differentiable on a set S, and let 
h(r, 0) = f(r cos0, r вїп Ө). 


If (r cos 0, r sin Ө) € 5, (5.4.10) implies that 


dh of ox Of dy 0f |. of 

— = —— + = 0—— 0— АП 

or | Ox дг И ду or с дх Tu ду ш ) 
and 

дһ  Ofox of dy of of 

аи аашаа шс 0—— rura 

© i уш (ORE AN 
where f, and f, are evaluated at (x, y) = (r соѕ 0, г sin Ө). a 


The proof of Corollary 5.4.4 suggests a straightforward way to calculate the partial 
derivatives of a composite function without using (5.4.10) explicitly. If h(U) = f(X(U)), 
then Theorem 5.4.3 , in the more casual notation introduced before Example 5.4.2, implies 
that 

dh = fa dxi + хо +-+: + 5х, (5.4.12) 


where d x4, dx», ..., dx, must be written in terms of the differentials dui, duo, ..., dum 
of the independent variables; thus, 
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OX; OX; OX; 
dxi = Do ductu duz + EE dum. 


Substituting this into (5.4.12) and collecting the multipliers of du, du», ..., dum yields (5.4.10). 


Example 5.4.3 If 
h(r,8,z) = f(x(r,0), y(r, 0), 2), 


then 
dh = fx dx + fy dy + f; dz. 
x Е" a à 
y y 
= —d d dy= d d 
dx m +5200 an y= or "+5940 
hence, 
_ дх дх ду ду 
di - f (n ea) e (s dr + ч a8) + ла: 
- etg) dre (et to) 4+ fede 
so 


д д 
= fe Sed he = fes fra hz = fz. 
Example 5.4.4 Let 
A(x) = f(x, y (х, zG9) 2()). 


Then 
dh = fx dx + fydy + fz dz, (5.4.13) 
dy = yx dx + yz dz, (5.4.14) 
and 
dz = z' dx, (5.4.15) 


where the prime indicates differentiation with respect to x. Substituting (5.4.15) into 
(5.4.14) yields 


dy = (Yx + yzz') dx 
and substituting this and (5.4.15) into (5.4.13) yields 


dh = |fx + fy (vx + yzz) + fzz'] dx; 
hence, 
= fx + fyx + yzz) T fez’. 


Here fy, fy, and f; are evaluated at (x, y(x, z(x)), z(x)), yx and yz are evaluated at 
(x, z(x)), and z’ is evaluated at x. 
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Higher Derivatives of Composite Functions 


Higher derivatives of composite functions can be computed by repeatedly applying the 
chain rule. For example, differentiating (5.4.10) with respect to ug yields 


07h zs д Of Ox; 
дикди; — дик \дху ди; 


j=1 


n 2 n (5.4.16) 
n a a DA 
= Ox; дик Qui ў=1 ди; дик Ox; ` 
We must be careful finding 
а (60) 
дик Ox; | 
which really stands here for 
E 8f (X(U) | (5.4.17) 
дик Ox; 
The safest procedure is to write temporarily 
Of X) 
gX) = E 
xj 
then (5.4.17) becomes 
dg(X(U)) _ У dg(X(U)) дх,(0) 
дик = дх; дир ` 
Since 
dg — 0? f 
OX, Әх. дху” 
this yields 
д (22) - "^. Gf Dx, 
дик VOxk _ £ x; üxj OUR 
Substituting this into (5.4.16) yields 
ah = Of x; 2 дху хл Pf Әх. 
dup OU; — 2. ax; Quy OU; T З ди; 0x; OX; — CUR RR) 


To compute Ли (Uo) from this formula, we evaluate the partial derivatives of x1, x2, 
..., Xn at Uo and those of f at Хо = X(Uo). The formula is valid if x1, x2, ..., x, and 
their first partial derivatives are differentiable at Up and f, fx;, fro. ..., fx, and their first 
partial derivatives are differentiable at Xo. 

Instead of memorizing (5.4.18), you should understand how it is derived and use the 
method, rather than the formula, when calculating second partial derivatives of composite 
functions. The same method applies to the calculation of higher derivatives. 
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Example 5.4.5 Suppose that fy and fy in Example 5.4.2 are differentiable on an open 
set S in R2. Differentiating (5.4.11) with respect to r yields 


92h д (af ә (8f 
a mt (эк) +902 (ж) 
(5.4.19) 


2 дх af ду 3f ax | 0?f dy 
Е LA oy nö P ag A бу 
с (S5 or ш dy Ox =) "IP (5 ду or Ы ду2 =) 


if (x, y) € S. Since 


дх д2 f д2 f 
—— = 0, = = 0, d = 
3 cos 3 sin an Эх ду By Ox 
if (x, y) € S (Exercise 5.3.21), (5.4.19) yields 
07h 2 9? . 0? f 5 д2 f 
g:2- 5 6 ое D 


Differentiating (5.4.11) with respect to 0 yields 


07h . of of 9 (of . 9 (of 
=— —— 0— 0— | = 0— | — 
3637 sin 6 — + cos тш 36 (=) чча (2) 


КТ; af fir WO 
ааш ne ag eese (TE + a) 


af ax fy 
in gy, 
Td (зс; #@ ae =) 


Since 9 9 
" = —ғ5іп0 and = = r cos 0, 
it follows that 
2 2 2 
7 - = ~sino + еб — r sin Ө cos 0 (5 = эт) 
2 
+r (cos? 0 — sin? got 
дхду 


The Mean Value Theorem 
For a composite function of the form 
h(t) = fl), x2(t), tt) Xn(t)) 


where f is a real variable, x1, x2, ..., Xn are differentiable at fo, and f is differentiable at 
Xo = X(to), (5.4.8) takes the form 


h (to) = У fe; (X(9))x (to). (5.4.20) 


j=1 


This will be useful in the proof of the following theorem. 
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Theorem 5.4.5 (Mean Value Theorem for Functions of n Variables) 
Let f be continuous at Xy = (X11, X21,.-.,Xn1) and Хә = (x12, X22, . . . , Xn2) and dif- 
ferentiable on the line segment L from X, to Хэ. Then 


n 


f (X2) — fX) = Y Л, (Хо) (ко — xi) = (dxo f )(Xa — Xi) (54.21) 


i=l 
for some Хо on L distinct from X, and Хэ. 
Proof An equation of L is 

X= X(t) 2 tX2-(1—1)X,i, O<t< 1. 
Our hypotheses imply that the function 
A(t) = FXO) 
is continuous on [0, 1] and differentiable on (0, 1). Since 
xi(t) = txi2 + (1 — t)xii, 
(5.4.20) implies that 
n 
WO =X fe XO) Oi2 xa), 0«t«1. 
i=l 
From the mean value theorem for functions of one variable (Theorem 2.3.11), 
h(1) — h(0) = h'(to) 


for some to € (0, 1). Since h(1) = f(X25) and h(0) = f(X4), this implies (5.4.21) with 
Xo = X(to). ш 


Corollary 5.4.6 If fxi, fi. ..., fx, are identically zero in an open region S of R", 
then f is constant in S. 


Proof We will show that if Xo and X are in S, then f(X) = f (Xo). Since S is an open 
region, $ is polygonally connected (Theorem 5.1.20). Therefore, there are points 


Xo, X1,...,X, = X 
such that the line segment L; from X;_; to X; is in 5, 1 <i < n. From Theorem 5.4.5, 
n 
f (Ki) - f(Xia) = 9 x, PA: - Xii). 
i=l 
where X is on Lj and therefore in S. Therefore, 


fa (Xi) = f X) = +++ = f (Ki) = 0, 
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which means that а, f = 0. Hence, 


f (Xo) = fX) = +++ = /(Х„); 
that is, f(X) = f(Xo) for every X in S. a 


Higher Differentials and Taylor’s Theorem 


Suppose that f is defined in an n-ball B,(Xo), with p > 0. If X є B,(Xo), then 
X(t) = Xo + t(X — Xo) € B,(X), OK<t <1, 
so the function 
h(t) = f(X(t)) 
is defined for 0 « t < 1. From Theorem 5.4.3 (see also (5.4.20)), 


n 


WO = у f KOC — xio) 


i=1 


if f is differentiable in В„(Хо), and 


". 0 (ax 
о) = У) Ox; (x SEO Qi = s») (xj — xjo) 
j=l 1 


‘= 


ovS Pf) 


(xi = xio)(xj — xjo) 


ijai Ox; OX; 
if ху, feo, ++, fx, are differentiable in B,(Xo). Continuing in this way, we see that 
n 
д” f (X(t) 
WOO = JO Tada шу Ot n0 о) + Ci, чо) 6422) 


ірон 1 
if all partial derivatives of f of order < r — 1 are differentiable in В,(Хо). 


This motivates the following definition. 


Definition 5.4.7 Suppose that r > 1 and all partial derivatives of f of order < r — 1 
are differentiable in a neighborhood of Xo. Then the rth differential of f at Xo, denoted 
by d У, 15 defined by 


n 
3» д” f (Xo) 
dy, = —— —— — — dxi,dxi, ++ dX; Д 5.4.23 
žo f A xidi me, 7-0 ir ( ) 
i1,i2,...,ir —1 r 
where dx1, dx», ..., dx, are the differentials introduced in Section 5.3; that is, dx; is the 


function whose value at a point in R" is the ith coordinate of the point. For convenience, 
we define 


(dx) f) = f (X9). 
Notice that 40) f = dxf- ш 
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Under the assumptions of Definition 5.4.7, the value of 
д” f (Xo) 
дх;, üXi, 4 ы, üxi, 
depends only on the number of times / is differentiated with respect to each variable, 


and not on the order in which the differentiations are performed (Exercise 5.3.22). Hence, 
Exercise 5.3.12 implies that (5.4.23) can be rewritten as 


Or r! 9" f (Хо) 7 , " 
dy, = ао O 4х2)? --- (dXn)", (5.4.24) 


where 327 indicates summation over all ordered n-tuples (r1, r2, ..., rn) of nonnegative 
integers such that 
ri Hrot: +n =r 


and Ox, is omitted from the “denominators” of all terms in (5.4.24) for which r; = 0. In 
particular, ifn = 2, 


(r) д” f (хо, yo) " 
dy, f — | ) зг (ауу). 


Example 5.4.6 Let 


fo = Tye by 

where a and b are constants. Then 

0" f(x, y) -(- yr ! aJ bts 

дхі dyr- (1 + ax + byy t! 
so 

аў? = _ Dr - r Jb'— (х)! (ау)! 
of = (1 + ахо + byo)" +! 2, Ј К (аху (ау) 
(= 1)” и! 
= (аа b dy)” 
(1 + axo + byo)" +! Gare ») 


if 1 + ахо + byo #0. 


Example 5.4.7 Let 


n 


f(X) = exp | - Yo ajx |, 


j=l 


where a1, a2, ..., аһ are constants. Then 


9" f(X) 


= (—1yYa!! T2... а!" 
ita eae Mes 
1 2 n 
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Therefore, 


r! 


(dx) f)(9) = C1 0з afta}? ---a' (dx) (dxa)ra --- eser 


rir! гь! 
n 

x exp -) ajXjo 
j=1 


n 
= (—I)' (a1 dxı + аз dx2 +: + an хь)" exp | — у, ajXjo 
ja 


(Exercise 5.3.12). E 


The next theorem is analogous to Taylor’s theorem for functions of one variable (Theo- 
rem 2.5.4). 


Theorem 5.4.8 (Taylor’s Theorem for Functions of n Variables) Suppose 
that f and its partial derivatives of order < k are differentiable at Xo and X in R” and on 
the line segment L connecting them. Then 


k 


1 1 
x)- Y aP f(x - x АЁ xx 5.4.25 
f(X) 2, 7 Р + кту к 70-0) (5.4.25) 
for some X on L distinct from Xo and X. 
Proof Define 
h(t) = f(Xo + t(X — Xo)). (5.4.26) 
With Ф = X — Хо, our assumptions and the discussion preceding Definition 5.4.7 imply 
that h, h’, ..., АС) exist on [0, 1]. From Taylor's theorem for functions of one variable, 
k 
AMO)  n**U(r) 
h(1) — ————, 5.4.27 
(0 2. r! tU YD ( ) 
for some r € (0, 1). From (5.4.26), 
h(0) = f(Xo) and A(1) = fX). (5.4.28) 


From (5.4.22) and (5.4.23) with Ф = X — Xo, 


h(0) = (d) X-X), 1<r<k, (5.4.29) 
and 
n&+0 (x) = (dk f) X- Xo) (5.4.30) 
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where = 

X = Xo + t(X — Хо) 
is on L and distinct from X9 and X. Substituting (5.4.28), (5.4.29), and (5.4.30) into 
(5.4.27) yields (5.4.25). ш 


Example 5.4.8 Theorem 5.4.8 and the results of Example 5.4.6 with Xo = (0,0) and 
® = (x, y) imply that if 1 + ax + by > 0, then 


1 
l+ax+by 


(ax + by) 


k 
= түг r _4)k+1 
= У)" (ах + by) +) fae 


r=0 


for some т є (0, 1). (Note that т depends on k as well as (x, y).) 


Example 5.4.9 Theorem 5.4.8 and the results of Example 5.4.7 with Хо = 0 and 
® = X imply that 


" E CI 
ехр – У`а;х; =) 2i (a1x1 + 2X2 + `+: + аһхп)" 
j=l r=0 ` 


(21) 


je 
(К DI 


+ (a1X1 + d2X2 + -+-+ anXn 


for some t € (0, 1). ш 
By analogy with the situation for functions of one variable, we define the kth Taylor 
polynomial of f about Xo by 


k 
bos 
TX) = 9 0 DA- Xo) 


r=0 


if the differentials exist; then (5.4.25) can be rewritten as 


1 
Ў) = TO) + Go px «X — Xo). 


A Sufficient Condition for Relative Extreme Values 


The next theorem leads to a useful sufficient condition for local maxima and minima. It 
is related to Theorem 2.5.1. Strictly speaking, however, it is not a generalization of Theo- 
rem 2.5.1 (Exercise 5.4.18). 
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Theorem 5.4.9 Suppose that f and its partial derivatives of order < k — 1 are differ- 
entiable in a neighborhood N of a point Xo in IR" and all kth-order partial derivatives of 
f are continuous at Xo. Then 


fQ-TnX _ 


lim = 0. (5.4.31) 


X—Xo [X — Xo|* 


Proof Ife > 0, there is a 8 > 0 such that В; (Хо) C N and all kth-order partial 
derivatives of f satisfy the inequality 


ak f (X) 9* f (Xo) 


се ———————|«e, X є Bs(Xo). 5.4.32 
üxi,0xi, у дхи OX;,OXi,_, °° дхи S s 0) ( ) 


Now suppose that X € Bs(Xo). From Theorem 5.4.8 with k replaced by k — 1, 


РОХ) = Tk- (X) + ы dX fyx — Xo), (5.4.33) 


where X is some point on the line segment from Xo to X and is therefore іп Bs (Хо). We 
can rewrite (5.4.33) as 


FOX) -no)«gz[«Pox-x»-«fox-x»] ^^ 64» 
But (5.4.23) and (5.4.32) imply that 

(«КО fx — Xo) — (dg? /)(Х — Xo)| < n*e|X — Xo|* (5.4.35) 
(Exercise 5.4.17), which implies that 


СХ) - T(X)| лє 


< —, Xe В; (Хо), 
IX XF "m 5 (Xo) 
from (5.4.34). This implies (5.4.31). [| 
Let r be a positive integer and Хо = (x10, X20, ... , X49). A function of the form 
P(X) = Y areis (1 — x19) (хә — x20)? ++ Gs — хо)", (5.4.36) 


r 


where the coefficients {a+ r2...r„ } are constants and the summation is over all n-tuples of 
nonnegative integers (r1, 72, ..., r4) such that 


rrr. 


is a homogeneous polynomial of degree r in X — Xo, provided that at least one of the 
coefficients is nonzero. For example, if f satisfies the conditions of Definition 5.4.7, then 
the function 


p(X) = (dg) /)(Х — Xo) 
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is such a polynomial if at least one of the rth-order mixed partial derivatives of f at Xo is 
nonzero. 


Clearly, р(Хо) = 0 if p is a homogeneous polynomial of degree r > 1 in X — Xo. 
If p(X) > 0 for all X, we say that p is positive semidefinite; if p(X) > 0 except when 
X = Xo, p is positive definite. 

Similarly, p is negative semidefinite if p(X) < 0 or negative definite if p(X) < 0 for all 
X 5 Xo. In all these cases, p is semidefinite. 


With p as in (5.4.36), 
p(-X + 2X9) = (D p(X), 


so p cannot be semidefinite if r is odd. 
Example 5.4.10 The polynomial 
p(x, у, 2) = х®++у*+4°+ху+хд+ yz 


is homogeneous of degree 2 in X = (x, у, 2). We can rewrite p as 


[G +y? +042) +(e +x)’], 


оре 


р(х, у,2) = 


so p is nonnegative, and р(х, y, z) = 0 if and only if 


| 


+YH=VHtT=Z+X = 0, 


which is equivalent to (x, y, z) = (0, 0, 0). Therefore, р is positive definite and — p is 
negative definite. 
The polynomial 
р\(х, y, Z) = x? + y? +22  2xy 
can be rewritten as 
р1(х, yz) = (х + у)? +z, 
so pı is nonnegative. Since р1(1,—1,0) = 0, pı is positive semidefinite and —p is 
negative semidefinite. 


The polynomial 
p(x, у.) = x-y? + 2? 


is not semidefinite, since, for example, 
p2(1,0,0) 2 1 and p2(0,1,0) = I. а 
From Theorem 5.3.11, if f is differentiable and attains a local extreme value at Xo, then 
dx, f = 0, (5.4.37) 


since fx, (Хо) = fx, (Хо) = -+ = fx, (Хо) = 0. However, the converse is false. The next 
theorem provides a method for deciding whether a point satisfying (5.4.37) is an extreme 
point. It is related to Theorem 2.5.3. 
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Theorem 5.4.10 Suppose that f satisfies the hypotheses of Theorem 5.4.9 with k > 
2, and 
dOf=0 ((<г<к—1), af £0 (5.4.38) 
Xo^ ^ =" = d Xo d ds 


Then 


(a) Xo is not a local extreme point of f unless my is semidefinite as a polynomial in 
X — Xo. In particular, Xo is not a local extreme point of f if k is odd. 


(b) Xo is a local minimum point of f уау is positive definite, or a local maximum 


point уа f is negative definite. 


(c) кау is semidefinite, then Хо тау be a local extreme point of f, but it need not 
be. 


Proof From (5.4.38) and Theorem 5.4.9, 


fX- f(X9) – Zapa- Xo) 
lim — A = 0, (5.4.39) 
X>Xo X- Xo 
If X = Xo + tU, where U is a constant vector, then 
(dy? f)(X — Xo) = 10409 ANV), 


so (5.4.39) implies that 


/(Хо + tU) — f X0) — geo _ 


mun tk 
or, equivalently, 
. f(Xo +10) – fX) 1, (9 
lim M = (dg SU) (5.4.40) 


for any constant vector U. 


To prove (a), suppose that i f is not semidefinite. Then there are vectors О; and U2 
such that 
(dx) f)(Ui) > 0 and (dy) f)(Ux) < 0. 


This and (5.4.40) imply that 
f(Xo +1Ui) > f(Xo) and f(Xo + 1U5) < f(Xo) 


for t sufficiently small. Hence, Xo is not a local extreme point of f. 


To prove (b), first assume that di f is positive definite. Then it can be shown that 
there is a p > 0 such that 


(dX? f)(X — Xo) 


Е > p|X – Хој“ (5.4.41) 
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for all X (Exercise 5.4.19). From (5.4.39), there is a 8 > 0 such that 


1 
fŒ- f (Xo) = z dy) 7) – Xo) 


p. 
>-. if |K—Xo| <6. 
IX — Хој 2 1 | ol 


Therefore, 
FX) -= f Xo) > ZaD bes a —Xol* if |X—Xo| <8. 
This and (5.4.41) imply that 
F(X) - f(X) > ÊX -Xo if IX Xo| <ô, 


which implies that Xo is a local minimum point of f. This proves half of (b). We leave 
the other half to you (Exercise 5.4.20). 


To prove (c) merely requires examples; see Exercise 5.4.21. ш 


Corollary 5.4.11 Suppose that f, f, and fy are differentiable in a neigborhood of a 
critical point Хо = (хо, yo) of f and fxx, fyy, and fxy are continuous at (xo, yo). Let 


D = јх (хо, yo) fey (Xo. Yo) — ту (Хо, уо). 
Тһеп 


а Xo, Уо) is a local extreme point o if D > 0; (xo, yo) isa local minimum point i 
(a) (xo. yo) p y p 
Fixx (хо, yo) > 0, or a local maximum point if fxx(xo, yo) < 0. 


(b) (хо, yo) is not a local extreme point of f if D < 0. 
Proof Write (x — xo, y — yo) = (u, v) and 
p(u,v)- (dy? fu, v) = Au? + 2Buv + Cv’, 
where A = Х.х (хо, yo), B = fxy(Xo, Yo), and C = fyy(Xo, yo). so 
D = AC – В?. 


If D > 0, then A Æ 0, and we can write 


2B B? B? 
р(и,о) =A G + ae + =") + (c — =) v? 


This cannot vanish unless и = v = 0. Hence, dp f is positive definite if A > 0 or 
negative definite if A « 0, and Theorem 5.4.10(b) implies (a). 


If D « 0, there are three possibilities: 
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B D 
1. A Z 0; then p(1,0) = A and p (5 ) = 


В р 
2. C + 0; then р(0, 1) = C and p | 1, —— | = —. 
C C 
3. A = С = 0; then B + Oand p(1, 1) = 2B and p(1, —1) = —2B. 
In each case the two given values of p differ in sign, so Xo is not a local extreme point 


of f, from Theorem 5.4.10(a). п 


Example 5.4.11 If 


then 


fxG y) = 2axf(x,y), fy(x, y) = 2byf(x, у), 


so 
fx (0,0) = fy (0,0) = 0, 

and (0, 0) is a critical point of f. To apply Corollary 5.4.11, we calculate 
fxx(x, y) = Qa + 4a?x?) f(x, у), 
Луук, y) = (22 + 4b? y?) f(x, у), 
Say (x, y) = 4abxyf (x, у). 

Therefore, 

D = fax (0,0) fyy 0,0) — f2 (0,0) = (2a)(2b) — (00) = 4ab. 
Corollary 5.4.11 implies that (0, 0) is a local minimum point if a and b are positive, a local 


maximum if a and b are negative, and neither if one is positive and the other is negative. 
Corollary 5.4.11 does not apply if a or b is zero. 


5.4 Exercises 


In the exercises on the use of the chain rule, assume that the functions satisfy appropriate 
differentiability conditions. 


1. Under the assumptions of Theorem 5.4.3, show that Ug is an interior point of the 


domain of h. 
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Let h(U) = f(G(U)) and find dy,h by Theorem 5.4.3, and then by writing h 
explicitly as a function of U. 
(a) f(x,y) = 3x? + Axy? + 3x, 

gi(u,v) = verter}, (uo, vo) = (0, 1) 

ga(u, v) - eg *tv-l 


(b) Jong) = err, 
g1(u,v, ш) = logu —logv + logw, 
go(u,v,w) = —2logu — 3log w, 
g3(u,v,w) = logu + logv + 2logw, 


(с) f@,y) = @+y), 
gi(u,v) = ucosv, (uo, 00) = (3, 2/2) 
g2(u,v) = usinv, 


(uo, vo, Wo) = (1,1,1) 


(d у, о) = x? + y? + 2?, 
gi(u,v,w) = ucosvsinw, 
g2(u, v, ш) = u cos v cos ш, 
g3(u,v,w) = usinv; 


(uo, 00, Wo) = (4, 1/3, 1/6) 


Let h(r, 0, z) = f(x,y,z), where x = r cos0 and y = r sin 0. Findh,, hg, and 
hz in terms of fy, fy, and fz. 


Let h(r, 0,9) = f(x,y,z), where x = r sing cos0, y = r sinġ sin, апа z = 
r cos ф. Findh,, hg, and Ag in terms of fx, fy, and fz. 
Prove: 
(a) Ifh(u,v) = f(u? + v?), then vh, — uh, = 0. 
(b) Ifh(u,v) = f(sinu + cos v), then h, sinv + hy cosu = 0. 
(c) Ifh(u,v) = f(u/v), then uA, + vh, = 0. 
(d) Ifh(u, v) = f(g(u, v), —g(u. v)), then dh = (fx — fy) dg. 
Find hy and A; if 
(у, z) = g(x(y. 2), y, 2, w(y, 2)). 


Suppose that и, v, and f are defined on (—оо, оо). Let u and v be differentiable 
and f be continuous for all x. Show that 


d v(x) 
Ef fat SOWA- Хаби (о) 
X Ju(x) 


We say that f = f(x1, х2,..., Xn) is homogeneous of degree r if D y is open and 
there is a constant r such that 


Sf (tx1, tX2,...,tXn) = t (х1, X2,...,Xn) 
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10. 


11. 


12. 


13. 


14. 


15. 


16. 


17. 


whenever t > 0 and (x1, x2, ..., хп) апа (fx1,1x2,..., tx4) are in D y. Prove: If 
f is differentiable and homogeneous of degree r, then 


n 
n fa 1X2, ess Xn) = rf (x1, X2,- ., Xn). 
і=1 
(This is Euler’s theorem for homogeneous functions.) 


If h(r, 0) = f(r cos 0, г sin Ө), show that 


1 1 
Tex + f» = hrr + zh + z300. 


HINT: Rewrite the defining equationas f(x, у) = h(r (x, у), (х, у)), withr (x, у) = 
Vx? + y? and 0(x, у) = (апт! (y/x), and differentiate with respect to x and y. 
Let h(u, v) = f(a(u, v), b(u, v)), where a, = by and ay = —b,. Show that 


huu F hyv = (хх T Fi (a? + аў). 


Prove: If 
u(x,t) = f(x —ct) + g(x + сї), 
then м = C7Uxx. 


Let h(u, v) = f(u + v,u — v). Show that 


1 
(a) fax Љу = ть (b) fsx + Hy = 5 (им + hvv) 
Returning to Exercise 5.4.4, find л, апа h,o in terms of the partial derivatives of 
f. 
Let huy = О for all (u, v). Show that h is of the form 


h(u, v) = U(u) + V(v). 
Use this and Exercise 5.4.12(a) to show that if fxx — fy, = 0 for all (x, у), then 


f(x,y) = U(x + y) + V(x- y). 


Prove or give a counterexample: If f is differentiable and f; = 0 іп a region D, 
then f(x1, y) = f(xa, y) whenever (х1, y) and (x5, y) are in D; that is f(x, у) 
depends only on y. 


Find T3(X). 

(a) fG.y)-e*cosy, Xo = (0,0) 

(b) fœ, у) =e, Xo = (0,0) 

(c) f@yz=@+yt+z-3), Хо = (1,1,1) 
(d) f(x, у, 2) =sinxsinysinz, Xo = (0,0,0) 
Use Eqns. (5.4.23) and (5.4.32) to prove Eqn. (5.4.35). 


18. 
19. 


20. 
21. 


22. 


23. 


24. 
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Carefully explain why Theorem 5.4.9 is not a generalization of Theorem 2.5.1. 
Suppose that p is a homogeneous polynomial of degree r in Y and p(Y) > 0 for all 
nonzero Y in R”. Show that there is a p > 0 such that p(Y) > o|Y|" for all Y in 
R”. HINT: p assumes a minimum on the set (Y | [Ү| = 1} . Use this to establish the 
inequality in Eqn. (5.4.41). 
Complete the proof of Theorem 5.4.10(b). 
(a) Show that (0, 0) is a critical point of each of the following functions, and that 
they have positive semidefinite second differentials at (0, 0). 

р(х, y) =x? - 2xy c y! + x* + yf 

q(x, y) mx -2xyse y* ext c yt. 
(b) Show that D as defined in Corollary 5.4.11 is zero for both p and q. 
(c) Show that (0, 0) is a local minimum point of p but not a local extreme point 


of q. 
Suppose that p = p(x1,X2,...,Xn) is a homogeneous polynomial of degree r 
(Exercise 5.4.8). Let i1, i2, ..., İn be nonnegative integers such that 
iy tigt:::+in =k, 
and let 


D р(х\,хә,....Хп) 

дхи 0x7 «++ Oxy" 
Show that g is homogeneous of degree < r — k, subject to the convention that a 
homogeneous polynomial of negative degree is identically zero. 


q(X1,X2,..., Xn) = 


Suppose that f = (х1, X2, ..., Xn) is a homogeous function of degree r (Exer- 
cise 8), with mixed partial derivative of all orders. Show that 


д? КОРЕК О" 
S uuu зз с бъз.) 


дх{9дХ} 
i,j=l io 


and 


n 
OM a а 
у, жй Мнн) =r(r—1)(r7 — 2) f(x х2,..., Xn). 
MS дх; Ox; OXk 


Can you generalize these results? 
Obtain the result in Example 5.4.7 by writing 
F(X) — e 41 e 922 МАР eg dn*n , 
formally multiplying the series 
y: Yi 
бє S pay T quies 
= 


together, and collecting the resulting products appropriately. 
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25. Let 
/@х, у) = ee 


By writing 
oo 
(x t yy 
уе. у= у] ru 
г=0 ji 


and expanding (x + y)” by means of the binomial theorem, verify that 


= 7 a” f (0, 0 xot: 
du! = (Flaten 


CHAPTER 6 


Vector- Valued Functions 


of Several Variables 


IN THIS CHAPTER we study the differential calculus of vector-valued functions of several 
variables. 


SECTION 6.1 reviews matrices, determinants, and linear transformations, which are inte- 
gral parts of the differential calculus as presented here. 


SECTION 6.2 defines continuity and differentiability of vector-valued functions of several 
variables. The differential of a vector-valued function F is defined as a certain linear trans- 
formation. The matrix of this linear transformation is called the differential matrix of F, 
denoted by F’. The chain rule is extended to compositions of differentiable vector-valued 
functions. 


SECTION 6.3 presents a complete proof of the inverse function theorem. 


SECTION 6.4. uses the inverse function theorem to prove the implicit function theorem. 


6.1 LINEAR TRANSFORMATIONS AND MATRICES 


In this and subsequent sections it will often be convenient to write vectors vertically; thus, 


instead of X = (x1, X2,...,Xn) we will write 
X1 
X2 
X= ; 
Xn 


when dealing with matrix operations. Although we assume that you have completed a 
course in linear algebra, we will review the pertinent matrix operations. 


We have defined vector-valued functions as ordered n-tuples of real-valued functions, in 
connection with composite functions h = f o G, where f is real-valued and G is vector- 
valued. We now consider vector-valued functions as objects of interest on their own. 
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If fi, р, ..., fm are real-valued functions defined on a set D in IR", then 
Л 
h 
F = i 
Jm 
assigns to every X in D an m-vector 
AX) 
Р(Х) 
Е(Х) = | 
fm (X) 
Recall that fi, fo, ..., fm are the component functions, or simply components, of F. We 
write 
F:R"— R” 


to indicate that the domain of F is in IR" and the range of F is in R”. We also say that F is a 
transformation from R” to R”. If m = 1, we identify Е with its single component function 
fı and regard it as a real-valued function. 


Example 6.1.1 The transformation F : R? — R? defined by 


has component functions 


Л(, у) = 2х +3у, р(х, у) = -х+4у, В(х, у) = х- у. 


Linear Transformations 


The simplest interesting transformations from R” to IR" are the linear transformations, 
defined as follows 


Definition 6.1.1 A transformation L : R” — R” defined on all of R” is linear if 
LOA + Y) = LX) + L(Y) 


for all X and Y in R” and 
L(aX) = aL(X) 


for all X in R” and real numbers a. 
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Theorem 6.1.2 A transformation L : R” — R” defined on all of R” is linear if and 


only if 
d11X1 + d12X2 +++ + d1nXn 


d21X1 + d22X2 +++ danXn 
L(X) = : | (6.1.1) 


Ami X1 + Am2X2 + +++ + AmnXn 


where the aj; 's are constants. 


Proof If can be seen by induction (Exercise 6.1.1) that if L is linear, then 


L(aiXi + a2X2 +--+ + акХк) = a1L(Xi) + a2L(X2) +--+ + a&yL(X&) — (6.12) 


for any vectors X1, X5, ..., Хк and real numbers a1, a2, ..., ак. Any X in R” can be 
written as 
X1 1 0 0 
X2 1 0 
X= —xj|.]|tx]|.]|t'txexm 
Xn (0) (0) 1 


= x1E, + x2E2 + +--+ XnEn. 
Applying (6.1.2) with k = n, X; = E;, and a; = x; yields 


L(X) = xıL(Œ1) + x2LŒ2) + +++ + x; L(E,). (6.1.3) 
Now denote 
aij 
aaj 
L(E;) = я 
amj 
so (6.1.3) becomes 
а11 12 Ain 
a21 a22 a2n 
L(X) = xi : + хә : Toc Xn А 
Am1 m2 атп 


which is equivalent to (6.1.1). This proves that if L is linear, then L has the form (6.1.1). 
We leave the proof of the converse to you (Exercise 6.1.2). ш 


We call the rectangular array 
ајр 12 "ап 
аз] 421 с An 
А=| o. 0... (6.1.4) 


Ami Am2 `` Amn 
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the matrix of the linear transformation (6.1.1). The number aj; in the ith row and jth 
column of A is called the (i, j )th entry of A. We say that A is an m x n matrix, since A 
has m rows and n columns. We will sometimes abbreviate (6.1.4) as 


A= [aij]. 


Example 6.1.2 The transformation F of Example 6.1.1 is linear. The matrix of F is 


2 3 
-1 4 |. ш 
1 —1 


We will now recall the matrix operations that we need to study the differential calculus 
of transformations. 


Definition 6.1.3 

(a) Ifc is a real number and A = [a;;] is an m x n matrix, then cA is the m x n matrix 
defined by 

cA= [сау]; 

that is, cA is obtained by multiplying every entry of A by с. 

(b) If A = [aij] and B = [b;;] are m x n matrices, then the sum A + B is them x n 
matrix 

A +B = [aij + bij]; 

that is, the sum of two m x n matrices is obtained by adding corresponding entries. 
The sum of two matrices is not defined unless they have the same number of rows and 
the same number of columns. 

(c) If A = [aij] is an m x p matrix and B = [b;;] is a p x n matrix, then the product 
C = AB is the m x n matrix with 


p 
с = арбуу + aj2b2; Toc dipbp; = Уу абу, 1<і<т, 1<]ј <n. 
k=1 


Thus, the (i, j )th entry of AB is obtained by multiplying each entry in the ith row of 
A by the corresponding entry in the jth column of B and adding the products. This 
definition requires that A have the same number of columns as B has rows. Otherwise, 
AB is undefined. 


Example 6.1.3 Let 


1 2 0 1 1 
А=|—1 0 3 |, B-^|-10 2|, 
0 3 0 1 
and 
5 0 1 2 
C=; 3 0 -3 1 
1 0 -1 1 
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Then 
2(2) 2) 20) 42 4 
2А = | 2(-1) 2(0) 20) |=] —2 0 6 
2(0) 2(1) 2(0) 0 2 0 
and 
2+0 141 241 2 2 3 
А+В= | -1-1 0+0 3+2 |=] —2 0 5 
0+3 1+0 0+1 3 1 1 


The (2, 3) entry in the product AC is obtained by multiplying the entries of the second 
row of A by those of the third column of C and adding the products: thus, the (2, 3) entry 
of AC is 

CDO) 00083) + (3)—1) = —4. 


The full product AC is 
2 1 2 5 0 1 2 15 0 -3 7 
-1 0 3 30-3 1 |=| —2 0 -4 I 
0 1 0 10-1 1 3 0 -3 1 
Notice that A + C, B + C, CA, and CB are undefined. E 


We leave the proofs of next three theorems to you (Exercises 6.1.7—6.1.9) 
Theorem 6.1.4 IfA, B, and C are m x n matrices, then 
(А +В) + С = A + (В + C). 


Theorem 6.1.5 /f A and B are m xn matrices апат and s are real numbers, then (a) 
r(sA) = (rs); (b) (т + 5)А = rA + sA; (с) r(A + B) = 7А + rB. 


Theorem 6.1.6 /f A, B, and C are m x p, p x q, and q x n matrices, respectively, 
then (AB)C — A(BC). 


The next theorem shows why Definition 6.1.3 is appropriate. We leave the proof to you 
(Exercise 6.1.11). 


Theorem 6.1.7 


(a) Ifwe regard the vector 


Xn 


as ann x 1 matrix, then the linear transformation (6.1.1) can be written as 


L(X) = AX. 
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(b) If Ly and Lz are linear transformations from К" to R” with matrices Ау and Аз 
respectively, then cıLı + c2L2 is the linear transformation from R” to R” with 
matrix c4À, + c2À3. 

(c) TfL, : R” — R? and Lz : RP — R” are linear transformations with matrices A, 
and A», respectively, then the composite function L4 = Lz o Ly, defined by 

L3(X) = L2(L1(X)), 


is the linear transformation from R” to R” with matrix АЗА}. 


Example 6.1.4 If 


2x + 3y —X—y 
L,(X) = 3x + 2y and L2(X)= | 4x+y |, 
Sey x 
then 
2 3 -] - 
A, = 3 2 and А, = 4 1 
—] 1 1 0 
The linear transformation 
L = 24 + L5 
is defined by 
L(X) = 211 (X) + L2(X) 
2x + 3y =x- у 
=2| 3x+2y |+] 4x4+y 
—x+ y x 
3x + 5y 
= | 10x+5y 
—x + 2y 
The matrix of L is 
3 5 
A= 10 5 | = 2А; + A». 
-1 2 


Example 6.1.5 Let 


and 
u+ v 
1(0) = | -u-2v |:R? >R. 
3u+ v 
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Then L3 = L; oL, : R? > R? is given by 


(x +2y)+ (3x + 4y) 4х + бу 
їз(Х) = L2((Li(X)) = | —(х+2у)—2(3х+4у)) |= | —7х—10у 
3(x + 2y)+ (3х + 4y) 6x + 10y 
The matrices of Lı and Г аге 
1 1 
^-[j 3 and Ao=| —1 —2 
3 1 
respectively. The matrix of L3 is 
4 6 
C=] -7 —10 | = A2A1 
6 10 


1 2 x 1 1 и 
Lio =| 3 dl] LU=|- -2 B" 
and 
4 6 
їз(Х)=| -7 —10 bl 
6 10 у 


A New Notation for the Differential 


If a real-valued function f : R” — R is differentiable at Xo, then 
dxo f = te (Xo) dx, + Seo (Xo) ах ++ Ían Xo) dXn. 
This can be written as a matrix product 


ax, 


dxo f = [f X0) feo (Ko) +++ f, (Xo)] 
dx, 
We define the differential matrix of f at Xo by 
f (Xo) = [he (Xo). Љ (Хо). fen (X9)] 


and the differential linear transformation by 


ахі 


dx2 
dX = 


dXn 


367 


(6.1.5) 


(6.1.6) 
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Then (6.1.5) can be rewritten as 


dx, = f'(Xo) dX. (6.1.7) 


This is analogous to the corresponding formula for functions of one variable (Exam- 
ple 5.3.7), and shows that the differential matrix f’(Xo) is a natural generalization of the 
derivative. With this new notation we can express the defining property of the differential 
in a way similar to the form that applies for n = 1: 


id SX) — f (Xo) — f'(Xo9)(X — Xo) = 


li 0, 
X>Xo |X — Xo| 
where Хо = (X10,X20,---,Xno) and f'(Xo)(X — Xo) is the matrix product 
X1 — X10 
X2 — X20 
[ fx, (Xo) Fixx (Xo) b fx, (Xo)] 
Xn — Xn0 


As before, we omit the Xo in (6.1.6) and (6.1.7) when it is not necessary to emphasize 
the specific point; thus, we write 


f'-pf fec fe] and df-f'ax. 
Example 6.1.7 If 
f, y. z) = 4x?yz?, 
then 
f'àx,y,2)-—[8xyz? 4x?g? 12х2у22]. 
In particular, if Хо = (1, —1, 2), then 
f' (Xo) =[-64 32 — 48], 
so 


dx 

dx, = f'(Xo)dX =[-64 32 -—48]| dy 
dz 

= —64 dx + 32 dy — 48 dz. 


The Norm of a Matrix 
We will need the following definition in the next section. 


Definition 6.1.8 The norm, | A||, of an m x n matrix A = [aij] is the smallest number 
such that 
[AX] < ||A]] [XI 


for all X in R”. E 
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To justify this definition, we must show that ||A|| exists. The components of Y = AX 
are 
yi = айх + di2X2 +++ +GinXn, 1<і < т. 


Ву Schwarz’s inequality, 
у? S (ah tai +: + ах. 
Summing this over 1 <i < m yields 


n 


m 
2 <|] dca? хр. 


i21 ј=1 


Therefore, the set 
В = {K||AX| < К|Х| forall X іп В") 


is nonempty. Since B is bounded below by zero, B has an infimum o. If € > 0, then a + € 
is in B because if not, then no number less than œ + € could be in B. Then œ + € would be 
a lower bound for B, contradicting the definition of о. Hence, 


|AX| < (a -e)X, Xem". 
Since e is an arbitrary positive number, this implies that 
|AX| <a@|X|, Xem", 


soa € B. Since no smaller number is in B, we conclude that ||A || = o. 


In our applications we will not have to actually compute the norm of a matrix A; rather, 
it will be sufficient to know that the norm exists (finite). 


Square Matrices 


Linear transformations from R” to R” will be important when we discuss the inverse func- 
tion theorem in Section 6.3 and change of variables in multiple integrals in Section 7.3. 
The matrix of such a transformation is square; that is, it has the same number of rows and 
columns. 


We assume that you know the definition of the determinant 


ајр 412 © Gin 
421 422 `` An 
det(A) = 
Ani n2 *** Ann 
of an n x n matrix 
ајр 412 * Gin 
a21 422 © An 
A= 


n] Gn2 *** Ann 


370 Chapter 6 Vector- Valued Functions of Several Variables 


The transpose, A‘, of a matrix A (square or not) is the matrix obtained by interchanging 
the rows and columns of A; thus, if 


1 2 3 1 3 
A=] 3 1 4 |, then A’=] 2 1 1 
0 1 -2 3-4 .—2 


A square matrix and its transpose have the same determinant; thus, 
det(A') = det(A). 
We take the next theorem from linear algebra as given. 


Theorem 6.1.9 IfA andB are n x n matrices, then 
det(AB) = det(A) det(B). 


The entries a;;, 1 < i < n, of ann хп matrix A are on the main diagonal of A. The nxn 
matrix with ones on the main diagonal and zeros elsewhere is called the identity matrix and 
is denoted by I; thus, ifn = 3, 


1 0 0 
I=; 0 1 0 
0 0 1 


We call I the identity matrix because AI = A and IA = A if A is any n x n matrix. We 
say that an n x n matrix A is nonsingular if there is an n x n matrix A^ !, the inverse of A, 
such that AAT! = A^!A = I. Otherwise, we say that A is singular 

Our main objective is to show that an n x n matrix A is nonsingular if and only if 
det(A) Z 0. We will also find a formula for the inverse. 


Definition 6.1.10 Let A = [a;;] be an n x n matrix, with n > 2. The cofactor of an 
entry aj; is Т 
cij = (1) 7 det(A;;), 


where A;; is the (n — 1) x (n — 1) matrix obtained by deleting the ith row and jth column 
of A. The adjoint of A, denoted by adj(A), is the n x n matrix whose (i, j )th entry is c ji. 


Example 6.1.8 The cofactors of 
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are 
-1 2 8. 2 3: | 
m ЕЕ C1 |G 2|576 сз= In 15 3 
1 4 1 4 2 
a=- if C22 — 0 2 Lt 8, C23 — Zr 1 = — 4, 
2 1 4 1 4 2 
m-| 2 |= Е sg! pe Сзз= IZ MELLE 
so 
—4 -3 5 
adj((A)=] -6 8 —5 
3 —4 —10 
Notice that adj(A) is the transpose of the matrix 
—4 —6 3 
—3 8 -4 
5 —5 —10 
obtained by replacing each entry of A by its cofactor. E 


For a proof of the following theorem, see any elementary linear algebra text. 


Theorem 6.1.11 Let A beann x n matrix. 


(a) The sum of the products of the entries of a row of A and their cofactors equals det(A), 
while the sum of the products of the entries of a row of A and the cofactors of the 
entries of a different row equals zero; that is, 


n 
det(A), i= j, 
у GjkCjk = lo Р : (6.1.8) 
k=1 | Le 


(b) The sum of the products of the entries of a column of A and their cofactors equals 
det(A), while the sum of the products of the entries of a column of A and the cofactors 
of the entries of a different column equals zero; that is, 


n 
det(A), i= j, 
у Ск аку = | р . (6.1.9) 
Z 0, i + ]. 


If we compute det(A) from the formula 


n 
det(A) = 5 аксі, 
k=1 
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we say that we are expanding the determinant in cofactors of its ith row. Since we can 
choose i arbitrarily from {1,..., n}, there are n ways to do this. If we compute det(A) 
from the formula 


n 
det(A) — у, акс, 
К=1 


we say that we are expanding the determinant in cofactors of its j th column. There аге also 
n ways to do this. 


In particular, we note that det(I) = 1 foralln > 1. 


Theorem 6.1.12 Let A be ann x n matrix. If det(A) = 0, then A is singular. If 
det(A) Z 0, then A is nonsingular, and A has the unique inverse 


1 
А! = da) adj(A). (6.1.10) 


Proof If det(A) = 0, then det(AB) = 0 for any n x n matrix, by Theorem 6.1.9. 
Therefore, since det(I) = 1, there is no matrix n x n matrix B such that AB = I; that is, A 
is singular if det(A) = 0. Now suppose that det(A) Z 0. Since (6.1.8) implies that 


A adj(A) = det(A)I 


and (6.1.9) implies that 

adj(A)A = det(A)I, 
dividing both sides of these two equations by det(A) shows that if A~! is as defined in 
(6.1.10), then AAT! = AT!A = I. Therefore, A^! is an inverse of A. To see that it is the 


only inverse, suppose that B is ап n x п matrix such that AB = I. Then A ! (AB) = A^, 
so (A! AJB = A^!. Since АА! = I and IB = B, it follows that B = A^. ш 


Example 6.1.9 In Example 6.1.8 we found that the adjoint of 


4 2 1 
A=] 3 —1 2 
0 1 2 
is 
—4 —3 5 
adj(A) = | —6 8 —5 
3 —4 —10 


We can compute det(A) by finding any diagonal entry of A adj(A). (Why?) This yields 
det(A) — —25. (Verify.) Therefore, 


=Å -3 5 
A!2-—|-6 8 —5 |. [| 
3 —4 =10 


Section 6.1 Linear Transformations and Matrices 373 


Now consider the equation 


АХ = Ү (6.1.11) 
with 
dii 412 Qin Xi yı 
азу 422 Q2n X2 y2 
A= . y х= ‚ and Y= 
Ani @п2 *** Ann Xn Yn 


Here A and Y are given, and the problem is to find X. 


Theorem 6.1.13 The system (6.1.11) has a solution X for any given Y if and only if 
A is nonsingular. In this case, the solution is unique and is given by X = A !Y. 


Proof Suppose that A is nonsingular, and let X = A^! Y. Then 
AX = A(A ! Y) = (AA !)Y = IY = Y; 


that is, X is a solution of (6.1.11). To see that X is the only solution of (6.1.11), suppose 
that AX, — Y. Then AX, — AX, so 


A AX) = A ! (AXi) 


and 
(A! AJX = (A ! AXi, 


which is equivalent to IX = IX,, or X = Xj. 


Conversely, suppose that (6.1.11) has a solution for every Y, and let X; satisfy AX; — 
E;, 1 <i <n. Let 
B= [X; X2 ps Xn]; 


that is, X1, Xo,..., X, are the columns of B. Then 
AB = [AX; АХ»... АХ„] = [E; E --- E,] = I. 


To show that B = A~!, we must still show that BA = I. We first note that, since AB = I 
and det(BA) — det(AB) — 1 (Theorem 6.1.9), BA is nonsingular (Theorem 6.1.12). Now 
note that 

(BA)(BA) — B(AB)A) — BIA; 


that is, 
(BA)(BA) — (BA). 
Multiplying both sides of this equation on the left by ВА)! yields BA = I. " 


The following theorem gives a useful formula for the components of the solution of 
(6.1.11). 
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Theorem 6.1.14 (Cramer's Rule) /f A = [aij] is nonsingular, then the solu- 
tion of the system 


üj1X1 + d12X2 +++ + AinXn = V1 


ü21X1 + d22X2 + +++ + @2пХа = y2 


AniX1 + An2X2 + +++ + AnnXn = Yn 
(or, in matrix form, AX = Y) is given by 


Di 1<1 < 
Xi = ——, 1 п, 
' © det(A) == 


where Dj is the determinant of the matrix obtained by replacing the ith column of A with 
Y; thus, 


yı 412 `t’ Gin а Yi 413 +t Qin 
У2 A22 ... ап 421 y2 423 `` аһ 
Di-|. EM . |, D= К } "ED 

Yn n2 `` Ann Ani Yn 4n3 ` Ann 

ü1] сз Ain- Yı 

421 сз G42n-1 y2 

D, = ‘ 

аһ ***  Ün,n—1 Yn 


Proof From Theorems 6.1.12 and 6.1.13, the solution of AX = Y is 


X1 C11 C21 > Cm yı 

X2 a-y 1 C12 C22 '"'* Cn2 y2 
det(A) 

Xn Cin C2n ^^^ Cnn Yn 


C11 Y1 + C21 Y2 +++ + Сп Уп 
C12)1 + €C22y2 +++ + Cn2Yn 


CinY1 + C2nY2 ++: + CnnYn 


But 
yı 412 с Gin 


y2 022 ... An 
спу + €21Y2 +: + Ст yn = . . a : : 


Уп Gn2 `` ап 
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as can be seen by expanding the determinant on the right in cofactors of its first column. 
Similarly, 


dii Yi dis ` Gin 
421  y2 423 с An 

C121 + C222 +++ + Cn2Yn = ; : , 
ап Уп пз -c^^ Ann 


as can be seen by expanding the determinant on the right in cofactors of its second column. 
Continuing in this way completes the proof. ш 


Example 6.1.10 The matrix of the system 


4x+2y+z=1 
3x— у +22 = 2 


у +22 = 0 
15 
4 2 1 
A=] 3 —1 2 
0 1 2 


Expanding det(A) in cofactors of its first row yields 


-1 2 3 2 
КЕНЕН 


3 —1 
аа 
= 4(—4) — 2(6) + 1(3) = —25. 
Using Cramer’s rule to solve the system yields 


1 1 2 1 4 


Ó 


2 1 1 2 
Фе у 2) Clas, ушж е есе 
2510 то! 5 25|9 9 2 5 
O rl е 
еа 


A system of n equations іп п unknowns 


411X1 + di2X2 +++ + AinXn = 0 
a21X1 + d22X2 +++: + d2nXn = 0 
(6.1.12) 


Ani X1 + An2X2 + +++ + annXn = 0 


(or, in matrix form, AX = 0) is homogeneous. It is obvious that Хо = 0 satisfies this 
system. We call this the trivial solution of (6.1.12). Any other solutions of (6.1.12), if they 
exist, are nontrivial. 


376 Chapter 6 Vector- Valued Functions of Several Variables 
We will need the following theorems. The proofs may be found in any linear algebra 
text. 


Theorem 6.1.15 The homogeneous system (6.1.12) of n equations inn unknowns has 
a nontrivial solution if and only if det(A) = 0. 


Theorem 6.1.16 /f Ai, Az,..., Ак are nonsingularnxn matrices, then so is Ay A2+++ Ax, 
and 


(A145 A) | = AD APT eA, 


6.1 Exercises 


1. Prove: If L : R” — R” is a linear transformation, then 
L(aiX; + a2X2 + ++- + akXy) = a1L(X1) + a2L(X2) + +++ + akL(Xy) 
if X1, Xo,..., Xy are in R” and a4, a2, ..., ар are real numbers. 
2. Prove that the transformation L defined by Бар. (6.1.1) is linear. 
3. Find the matrix of L. 


3x + 4y + 6z ле 
(a) L(X) = | 2x —474 22 (b) L(X) = iles 
7x z 2y hs 3z 7х1 = 4x2 
бх + X2 
4. FindcA. 
22 4 6 1 3 0 
(а)с=4,А=| 0 0 1 3 (b)c=-2,A=] 0 1 2 
3 7 1 1 -1 3 
5. FindA+B 
-1 2 3 -1 0 3 
(a) A= 1 1 4 |, B= 5 —7 
0 —1 4 0-1 2 
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13. 
14. 
15. 


16. 


17. 
18. 
19. 
20. 
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Prove Theorem 6.1.4. 

Prove Theorem 6.1.5. 

Prove Theorem 6.1.6. 

Suppose that A + B and AB are both defined. What can be said about A and B? 
Prove Theorem 6.1.7. 

Find the matrix of aL; + Р12. 


3x +2у + z 
(a) Li, у, 2) = x+4y+2z |, 
3x—4y+ z 
—x+y- zZ 
Li(x,y,z)= | -2x+y+3z |, a=2, b-—-1 
yt z 
2x + 3y 3x—y 
(b Li.y)=] x- y |, (у) = | x+y |, a=4, b= 
4x+ y —x—y 


Find the matrices of L1oL» and 101, where L; and L3 are as in Exercise 6.1.12(a). 
Write the transformations of Exercise 6.1.12 in the form L(X) — AX. 

Find f’ and f’(Xo). 

(a) f(x, у, 2) = 3х2у2, Xo =(1,-1,1) 

(b) f(x,y) =sin(x + у), Xo = (1/4, 2/4) 

(c) fœ, yz) = xye^7*, Xo = (1,2, 0) 

(d) f(x,y,z) = tan(x +2y +z), Xo = (1/4, 1/8, 2/4) 

(е) f(X) = IXI: R^ >R, Xo = (1/ i, 1/ n. ....1/ fr) 


Let A = [a;;] be an m x n matrix and 
А = max {|а||1<ї<т‚,1<ї<п}. 


Show that | A|| < A./mn. 

Prove: If A has at least one nonzero entry, then || А || 4 0. 
Prove: [А + B|| < ||А|| + ||B]. 

Prove: ||AB|| < А IIB]. 


Solve by Cramer’s rule. 


| 
Un 


x+ y+2z= 1 x+ у= z= 
(a) 2x- y+ z-2-1 (b) 3x - 2y + 2z 
x—2y—3z= 2 4х + 2у – 32 = 14 


Il 
© 
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" х= y+ z-2w= 1 
x+2y+3z=-5 Ie y= Sew: 4 
() x - z--1 (d) = 
+ у+2г——4 3x +2у + ш=13 
ек ge = 2x+ y- z = 4 
21. Find AT! by the method of Theorem 6.1.12. 
1 2 
(a) = (bÞì)| 1 0-1 
3 4 
1 
4 2 1 1 0 1 
(с)| 3 -1 2 (d)| 0 1 1 
0 1 2 1 1 0 
1 2 0 0 1 1 2 —1 
—2 3 0 0 2 2 — 3 
(0! оо 23 Olea 43 9 
0 0 -1 2 3 1 0 1 
22. Forl < i,j < т, let aj; = ajj(X) be a real-valued function continuous on a 


compact set K in IR". Suppose that the m x m matrix 
A(X) = [ai;(X)] 
is nonsingular for each X in K, and define the m x m matrix 
B(X, Y) = [b;; (X. Y)] 


by 
B(X,Y)—-A !(X)A() - I. 


Show that for each є > 0 there is a ô > 0 such that 
lb (X, Y) «e, 1<i,j<m, 
if X, Y € K and |X — Y| < ô. HINT: Show that bj; is continuous on the set 
(X. Y)XeK,YeKk). 
Then assume that the conclusion is false and use Exercise 5.1.32 to obtain a contradiction. 


6.2 CONTINUITY AND DIFFERENTIABILITY OF TRANS- 
FORMATIONS 


Throughout the rest of this chapter, transformations F and points X should be considered as 
written in vertical form when they occur in connection with matrix operations. However, 
we will write X = (x1, x5, ..., Xn) when X is the argument of a function. 
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Continuous Transformations 


In Section 5.2 we defined a vector-valued function (transformation) to be continuous at Xo 
if each of its component functions is continuous at Жо. We leave it to you to show that this 
implies the following theorem (Exercise 1). 


Theorem 6.2.1 Suppose that Xo is in, and a limit point of, the domain of F : R" > 
IR". Then F is continuous at Xo if and only if for each є > 0 there is a ё > 0 such that 


|F(X) – Е(Хо)| <€ if |X—Xo| <6 and Xe Dy. (6.2.1) 


This theorem is the same as Theorem 5.2.7 except that the "absolute value" in (6.2.1) 
now stands for distance in IR" rather than IR. 


If C is a constant vector, then “пх х F(X) = C" means that 
lim |F(X) – C| = 0. 
n [ROO ct 
Theorem 6.2.1 implies that F is continuous at Xo if and only if 


yim F(X) = Е(Хо). 


Example 6.2.1 The linear transformation 


x+ yz 
L(X) = | 2x-3y+z 
2x+ y-z 


is continuous at every Xo in R3, since 


(x — xo) + (y — yo) + (с — zo) 
L(X) -L(Xo)) = L(K— Xo) = | 2(x — x0) -3(y — уо) + Z ^zo) |. 
2(x — xo) + (y — yo) – (С — zo) 


and applying Schwarz's inequality to each component yields 
IL(X) - L(Xo)? < (3 + 14 + 6)|X — Хор? = 23IX — Хор. 
Therefore, 
€ 


L(X)-L(X9| «e if |X—Xo| < 
IL(X) — L(Xo)| | ol Ta 


Differentiable Transformations 


In Section 5.4 we defined a vector-valued function (transformation) to be differentiable at 
Xo if each of its components is differentiable at Xo (Definition 5.4.1). The next theorem 
characterizes this property in a useful way. 
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Theorem 6.2.2 A transformation F = (fi, fo,..., fm) defined in a neighborhood of 
Xo € R” is differentiable at Xo if and only if there is a constant m x n matrix A such that 


F(X) — F(Xo) -A(X - Xo) _ 


lim 0. (6.2.2) 
хх IX — X 
If (6.2.2) holds, then A is given uniquely by 
ОЛ Со) MAK) Afi (Ko) 
дх\ 0X2 Q Xn 
| 9fa(Xo) | 8f2(Xo) 9f2(Xo) 
A= E Zo) = дх\ дх2 Әх» | (6.2.3) 
дх; | ' | 
д/м(Х) SmX) 9/„(Хо) 
0x1 0x2 OXn 


Proof Let Xo = (X10,%20,..-,Xno). If F is differentiable at Xo, then so are fi, fo, 
..., fm (Definition 5.4.1). Hence, 


” 0f (X 
ло) — fi) - Y; AO, — x70) 
mum J 
| p —— —— ER 
XXo [X — Xo| 


which implies (6.2.2) with A as in (6.2.3). 


Now suppose that (6.2.2) holds with A = [a;;]. Since each component of the vector in 
(6.2.2) approaches zero as X approaches Xo, it follows that 


n 
fX) — fi(Xo) — У а(х; — хдо) 
lim ————————LÁ——————— 20, 1<ї<т, 
X>Xo IX — Xo 

so each f; is differentiable at Xo, and therefore so is F (Definition 5.4.1). By Theo- 
rem 5.3.6, 
_ Ofi (Xo) 

Ox; | 
which implies (6.2.3). E 

A transformation T : R” — R” of the form 


dij l<i<m, 1<j<K<n, 


TX) = U+ A(X - Xp), 


where U is a constant vector in R”, Xo is a constant vector in IR", and A is a constant m xn 
matrix, is said to be affine. Theorem 6.2.2 says that if F is differentiable at Xo, then F can 
be well approximated by an affine transformation. 
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Example 6.2.2 The components of the transformation 
x? +2ху +z 
F(X) = | x +2xz+y 
х?+ у? +2? 


are differentiable at Хо = (1, 0, 2). Evaluating the partial derivatives of the components 
there yields 


22 1 
A=] 5 1 2 
2 0 4 
(Verify). Therefore, Theorem 6.2.2 implies that the affine transformation 


TX) = F(Xo) + A(X — Xo) 


3 22 1 x-1 
= 5 |+| 5 1 2 y 
5 20 4 z—2 


satisfies 
F(X)-T(X) 


xoXo |X-Xo| 


Differential of a Transformation 


ГЕ = (fi. fo. .... fm) is differentiable at Xo, we define the differential of F at Xo to be 
the linear transformation 


dx, fi 
dx, f: 
EE] (6.2.4) 
Ях, Ím 
We call the matrix А in (6.2.3) the differential matrix of F at Xo and denote it by F'(Xo); 
thus, 
ОЛ Со) AXo) Afi (Ko) 
Ox, 0x2 OXn 
IHX) IHX) Xo) 
(Хо) = | 9?" ma "e || (6.2.5) 
дт (Хо) fm (Хо) - дт (Хо) 


дх1 0x2 OXn 
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(It is important to bear in mind that while Е is a function from IR" to IR", F’ is not such 
a function; F' is an m x n matrix.) From Theorem 6.2.2, the differential can be written in 
terms of the differential matrix as 


ax, 


dx2 
йх,Е —F(Xo)| . (6.2.6) 


d Xg 
or, more succinctly, as 
dx F = F'(Xo) dX, 


where 
dx 1 


ахә 
ах = 


ахһ 
as defined earlier. 


When it is not necessary to emphasize the particular point Xo, we write (6.2.4) as 


dfi 
df. 
dF=-| 7 
ris 
(6.2.5) as 
ah af ал 
Ox, 0x2 OXn 
dh th dh 
F= Ox, 0x2 OXn 
Ofm д/п fm 
Ox, дхә OXn 
and (6.2.6) as 
dF = F'dX. 


With the differential notation we can rewrite (6.2.2) as 


i F(X) — Е(Хо) — Е'(Хо)(Х — Xo) _ 
wm ——————————————————— Z 


0. 
X5Xo [X — Xo| 
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Example 6.2.3 The linear transformation 
ахі + d12X2 +*+: + AinXn 
d21X1 + d22X2 + +++ + A2nXn 
F(X) = 
ат Хі + dm2X2 + +++ + AmnXn 
can be written as F(X) = AX, where A = [a;;]. Then 
Е =A; 


that is, the differential matrix of a linear transformation is independent of X and is the 
matrix of the transformation. For example, the differential matrix of 


1 2 3 
Fens) =| › 1 3 X2 


, | 1 23 
КЕ | 2 104° 
If F(X) = X (the identity transformation), then F’ = I (the identity matrix). 


Example 6.2.4 The transformation 


x 
F(x,y)= | —2» 
x2 + y2 

2xy 


is differentiable at every point of R2 except (0, 0), and 


y? — x? 2xy 
Gye Ey? 
Е' (х,у) = 2ху x? — у? 
2y +y 
2y 2x 
In particular, 
0 —ł 
2 
= 1 
Е'(1, 1) p 72 0 , 
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so 
1 1 
2 0 -5 
! x—1 
lim —— = |Fey)-| 4 |-|- o | | 
(х,у)—>(1,1) y(x — 1)? + (у — 1)? (x, y) 2 2 у—1 
2 2 2 
0 
=| 0 н 
0 


If m — n, the differential matrix is square and its determinant is called the Jacobian of 
F. The standard notation for this determinant is 


afi дА af 
E - rs 
M. dh dh 
ОЛЛО | x1 Bx. :? 
O(xi,X2,... Xn) — А : ; 
Ifa дў, dfn 
ðxı 0X2 7 OXn 


We will often write the Jacobian of F more simply as J(F), and its value at Xo as JF(Xo). 


Since ann x n matrix is nonsingular if and only if its determinant is nonzero, it follows 
that if F : R” — R” is differentiable at Xo, then F'(Xo) is nonsingular if and only if 
JF(Xo) 4 0. We will soon use this important fact. 


Example 6.2.5 If 


х2 2х +z 
F(x, у, 2) = х + 2ху + z^ |, 
X+y+Z 
then 

2x-2 0 1 

0 * 9 
Hs fo f) recy = 1+2y 2x 2z 
0 (X1, X2, хз) 1 1 1 

MEET E - 1+2y 2x 


= (2x — 2)Qx — 2z) + (1 + 2y — 2x). 
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In particular, JF(1, —1, 1) = —3, so the differential matrix 
0 0 1 
Е(1,—1,1)= | -1 2 2 
1 1 1 
is nonsingular. 


Properties of Differentiable Transformations 


We leave the proof of the following theorem to you (Exercise 6.2.16). 

Theorem 6.2.3 [fF : R” — R” is differentiable at Xo, then F is continuous at Xo. 
Theorem 5.3.10 and Definition 5.4.1 imply the following theorem. 

Theorem 6.2.4 Let F = (fi, р,..., fm) : R” — К”, and suppose that the partial 


derivatives T 
Lia l<i<m, lxjczn, (6.2.7) 
Ox; 


exist on a neighborhood of Xo and are continuous at Xo. Then F is differentiable at Xo. 


We say that F is continuously differentiable on a set S if S is contained in an open set 
on which the partial derivatives in (6.2.7) are continuous. The next three lemmas give 
properties of continuously differentiable transformations that we will need later. 


Lemma 6.2.5 Suppose that Е : К" — R” is continuously differentiable on a neigh- 
borhood N of Xo. Then, for every є > 0, there isa ô > 0 such that 


EFX) — F(Y)| < (Е (Хо) + 9IX — Y|. if A. Y € Bs(Xo). (6.2.8) 
Proof Consider the auxiliary function 
G(X) = F(X) — Е'(Хо)Х. (6.2.9) 
The components of G are 


P3 9fi(Xo)üx; 


s) = fi) – —, 


, 


j=1 


j dgi(X) AN _ Afi (Ko) 


Ox; Ox; Ox; 
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Thus, 0g; /0x; is continuous on N and zero at Xo. Therefore, there is a 5 > 0 such that 


9g; (X) € ; 

« fo 1<і<т, 1<j<n, if |X—Xo| <. 6.2.10 
| ax; Dm Es SJE | o] ( ) 

Now suppose that X, Y є В; (Хо). By Theorem 5.4.5, 

n 

ðgi (Xi) 

gi(X) - g(Y) =} | (xj - у), (6.2.11) 
j=l 7 


where X; is on the line segment from X to Y, so X; € Bs(Xo). From (6.2.10), (6.2.11), 
and Schwarz's inequality, 


0g; (Xi) 
Ox; 


n 2 2 
(0) - s < |У | | хур < x - vp. 


j=l 
Summing this from i = 1 toi = m and taking square roots yields 
IG(X) — G(Y)| « e|X — Y| if X,Y € Bs(Xo). (6.2.12) 
To complete the proof, we note that 
F(X) — F(Y) = G(X) — G(Y) + F'(Xo)(X — Y), (6.2.13) 
so (6.2.12) and the triangle inequality imply (6.2.8). a 


Lemma 6.2.6 Suppose that F : IR" — R” is continuously differentiable on a neigh- 
borhood of Xo and F' (Xo) is nonsingular. Let 


1 


r= ——______, (6.2.14) 
IEX) || 
Then, for every є > 0, there isa ô > 0 such that 
[F(X) – Е(Ү)| > (r—e))X—Y| if X,Y € Bs(Xo). (6.2.15) 


Proof Let X and Y be arbitrary points in Dy and let G be as in (6.2.9). From (6.2.13), 


EX) — F(Y)| > [E XVX — Y)| — |G(X) — G(Y)]. (6.2.16) 
Since 
X — Y = [F(Xo)] !Е'(Хо)(Х - Y), 
(6.2.14) implies that 
1 

IK-Y|x- [F'(Xo)(X — Y|, 
50 

IF (Xo)(X — Y)| > r|X — Y|. (6.2.17) 


Now choose ó > 0 so that (6.2.12) holds. Then (6.2.16) and (6.2.17) imply (6.2.15). [| 


See Exercise 6.2.19 for a stronger conclusion in the case where F is linear. 
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Lemma 6.2.7 ГЕ: R” — R” is continuously differentiable on an open set containing 
a compact set D, then there is a constant M such that 


|F(Y) — Е(Х)| < MY-X| if X.YeD. (6.2.18) 
Proof On 
S-(XY|XYen)cm?" 
nd IFY) — F(X) - F(X)(¥ - X)| 
g(X, Y) = IY — Х| к Ке, 
0, Ү =x. 


Then g is continuous for all (X, Y) іп S such that X 5 Y. We now show that if Хо € D, 
then 


lim g(X, Y) = 0 = g(Xo, Xo); (6.2.19) 
(X, Y)— (Xo.Xo) 


that is, g is also continuous at points (Xo, Xo) in S. 


Suppose that e > 0 and Xo € D. Since the partial derivatives of fi, fo, ..., fim are 
continuous on an open set containing D, there is a 6 > 0 such that 


AVD AV E 
дх; Ox; mn 
(Note that д/; /0x ; is uniformly continuous оп В; (Ҳо) for б sufficiently small, from The- 


orem 5.2.14.) Applying Theorem 5.4.5 to fi, fo, ..., fm, we find that if X, Y є Bs(Xo), 
then 


if X,Y € B;(Xo), 1 ci Em, 1x j <n. (6220) 


AQ - 50) =); 


Ј=1 


: 9л (Xi) ( 27 
Әх. yj j^ 
where X; is on the line segment from X to Y. From this, 
2 2 


"Of (X FIEX) af 
AQ)- fio - 7 Lo; —ху)| = 2 | in = [ej -xj) 
Р j=l М 4 


j=l 
уху [2590 _м@] 


Ox; Ox; 


ІЛ 


Ј=1 
(by Schwarz’s inequality) 


2 
<|¥Y-X/? (у(6.2.20)) 
m 
Summing from і = 1 toi = m and taking square roots yields 
|F(Y) — F(X) — F(X)Y — X)| «elY-X| if X,Y € Bs(Xo). 


This implies (6.2.19) and completes the proof that g is continuous on S. 
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Since D is compact, so is 5 (Exercise 5.1.27). Therefore, g is bounded on 5 (Theo- 
rem 5.2.12); thus, for some М, 


|F(Y) — F(X) - F(X)Y -X) < Mı|X - Y| if X.YeD. 
But 


[F(Y) — F(X)| < |Е(Ү) — F(X) - F'(X)(Y — X)| + |F X) — X) 


< (Mi + |F XDI — Х|. (6.2.21) 


Since 
1/2 


a ATAT 
rool = CY 2209) 
J 


i21 j=1 


and the partial derivatives (0f; /0x;) are bounded on D, it follows that ||F'(X)|| is bounded 
on D; that is, there is a constant M» such that 


IF (Ol < М, XeD. 
Now (6.2.21) implies (6.2.18) with M = Mı + M5. [| 


The Chain Rule for Transformations 


By using differential matrices, we can write the chain rule for transformations in a form 
analogous to the form of the chain rule for real-valued functions of one variable (Theo- 
rem 2.3.5). 


Theorem 6.2.8 Suppose that F : R” — R” is differentiable at Хо, G : Rk — R” is 
differentiable at Uo, and Хо = G(Uo). Then the composite function H = F o G : RE > 
R” , defined by 

H(U) = F(G(U)). 


is differentiable at Ug. Moreover, 


H'(Uo) = F'(G(Uo))G' (Uo) (6.2.22) 
and 
dy pH = dx,F o 40,6, (6.2.23) 
where o denotes composition. 
Proof The components of H are Лү, h2, ..., Am, where 


h;(U) = fi(G(U)). 
Applying Theorem 5.4.3 to Л; yields 


” Of (X 
йым = V7 т 1xixm. (6.2.24) 
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Since 
dug hi du 21 
dy,h2 40082 
do H = ° апа арб = : 3 
Яроћт dU, n 


the m equations in (6.2.24) can be written in matrix form as 


du,H = F'(Xo)du,G = F'(G(Uo))du,G. (6.2.25) 
But 
doy G = G'(Uo) dU, 

where 

du, 

duz 

dU = я 3 
duy 


so (6.2.25) can be rewritten as 
du, H = F'(G(Uo))G' (Uo) dU. 


On the other hand, 
du, H = H' (Uo) dU. 


Comparing the last two equations yields (6.2.22). Since G’ (Uo) is the matrix of du, G and 
F'(G(Uo)) = F'(Xo) is the matrix of dx, F, Theorem 6.1.7 (c) and (6.2.22) imply (6.2.23). 
a 


Example 6.2.6 Let Uo = (1, —1), 


Ju 
x? + у? + 22? 
G(U = С(и, о) = | Vu? + 302 |, F(X) = Е(х, у, 2) = uM 
x“—y 
Jv +2 


and 
H(U) = F(G(U)). 


Since G is differentiable at Up = (1, —1) and F is differentiable at 
Xo = G(Uo) = (1,2,1), 


Theorem 6.2.8 implies that H is differentiable at (1, —1). To find H'(1, —1) from (6.2.22), 
we first find that 


390 Chapter 6 Vector- Valued Functions of Several Variables 


1 


— 0 
2./u 
; u 3v 
Сб (О = | —— ———— 
Ми? + 302 Ju? + 3v? 
1 
0 EAE 
2/u+2 
and 
" _ | 2x 2y 42 
Foo = | > —2у 0 
Then, from (6.2.22), 
H’(1,-1) = F(1,2, 1)6'(1, 21) 
4 0 
|2 4 4 E |_ 3 —4 
~ | 2 -4 0 2 2] |-1 6 
0 3 


We can check this by expressing H directly in terms of (u, v) as 


(vu)? + (а зе?) Ooo) 


H(u, v) = У 2 
(Vu)? - (vu? +30?) 


[p u+u? +302 +20 +4 
E и — u? — 3v? 


and differentiating to obtain 


/ = 
m.» =| 1-2u  -6v 


H'(1,-1) = | E Е: 1. 


which yields 


as we saw before. 


6.2 Exercises 


1. Show that the following definitions are equivalent. 


(a) F = (fi, fo. .... fm) is continuous at Xo if fi, fo, ..., fm are continuous 
at Xo. 
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(b) F is continuous at Xo if for every є > 0 there is a ó > 0 such that |F(X) — 
F(Xo)| < eif |X — Xo| < ô and X є Dr. 
Verify that 
lim Е(Х) – Е(Хо) – Е(Хо)(Х – Хо) _ 


0. 
X>Xo IX — Xo| 


3x + 4y 
(а) Е(Х) = | 2x- у |. Xo = (xo, yo. zo) 
х+ у 
2x? + ху+1 
(b) F(X) = xy » Xo =(1,-1) 
х2 + у? 
sin(x + у) 
(с) Е(Х) = | siny +z) |, Xo = (x/4,0,/4) 
ѕіп(х + 2) 
Suppose that Е : R” — R” and л : R” — R have the same domain and аге 


continuous at Xo. Show that the product AF = (hf, hfo,...,hfm) is continuous at 
Xo. 


Suppose that F and G are transformations from R” to R” with common domain D. 
Show that if F and G are continuous at Xo € D, then so are F + G and F — G. 


Suppose that F : R” — R” is defined in a neighborhood of Xo and continuous at 
Xo, С: Rk > R” is defined in a neighborhood of Up and continuous at Uo, and 
Xo = С(00). Prove that the composite function Н = F o С is continuous at Ug. 


Prove: If F : R” — R” is continuous on a set S, then |F| is continuous on 5. 


Prove: ҤЕ: R” — R” is continuous on a compact set S, then |F| is bounded on 
S, and there are points Xo and X, in 5 such that 


[F(Xo)| < |F(X)| < |F(Xi)|, Xe 5; 


that is, |F| attains its infimum and supremum on S. HINT: Use Exercise 6.2.6. 


Prove that a linear transformation L : R” — IR" is continuous on R”. Do not use 
Theorem 6.2.8. 


Let A be an m x n matrix. 
a) Use Exercises 6.2.7 and 6.2.8 to show that the quantitites 
(a) q 

|AX| 
|X| 


|AX| 
IX| 


МА) = max | Ix «e| and mA) = min | Ix «e| 


exist. HINT: Consider the function L(Y) = AY on S = (Y | lY| = 1} ; 
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10. 


11. 


12. 


13. 


14. 


(b) Show that M(A) = |А||. 
(c) Prove: If n > m orn = m and A is singular, then m(A) = 0. (This requires a 
result from linear algebra on the existence of nontrivial solutions of AX — 0.) 


(d) Prove: If n = m and A is nonsingular, then 
m(A)M(A !) = m(A M(A) = I. 


We say that F : IR" — IR" is uniformly continuous on S if each of its components 
is uniformly continuous on S. Prove: If F is uniformly continuous on S, then for 
each є > 0 there is a ё > 0 such that 


|F(X) — F(Y)| < € if |X—Y|<6 and X;Yec S. 
Show that if F is continuous on IR" and F(X + Y) = F(X) + F(Y) for all X and Y 
in IR", then A is linear. HINT: The rational numbers are dense in the reals. 
Find F' and JF. Then find an affine transformation G such that 
FX)-G(Y) _ 


li Я 
хо Х — Xo 0 
x*>+y+42z 
(a) F(x, y,z) = | cosx+y+z) |, Xo = (1, –1,0) 
eryve 
_ | e*cosy = 
(b) Fo») =| e* sin y | Xo = (0, 2/2) 
2 
X 
(c) Е(х,у,2) = | »?-z |, Xo= (1,1,1) 
eae 
Find F'. 
gi(x) 
x+y +z)e” 82(x) 
(а) во | CFP EOS | ува) | 
8п(х) 
ех sin yz 
(c) F(x, у, 2) = | e"sinxz 
e* sinxy 
Find F' and JF. 
КК, r cos 6 cos ф 
(a) F(r.0) — (b) F(r.0.9) = | rsin@cos¢ 
r sind ; 
rsing 
r cos Ө 


(c) F(r,0,z) = | rsin@ 
© 


15. 


16. 
17. 


18. 


19. 


20. 
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Prove: If G; and С» are affine transformations and 


С1(Х) — G2(Y) 
im ————— ——— = 0, 
X—Xo IX = Xo| 


then G; = G5. 
Prove Theorem 6.2.3. 


Show that if F : R” — R” is differentiable at Xo and є > 0, there is ad > 0 such 
that 
IEX) — F(Xo)| < (ПЕ (Хо) + 9)X— Xo] if |X— Хо < ô. 


Compare this with Lemma 6.2.5. 
Suppose that F : IR" — R” is differentiable at Xo and F' (Xo) is nonsingular. Let 


1 
TP RO 
and suppose that € > 0. Show that there is a 6 > 0 such that 
[F(X) — F(X9)| > (r - e9))X Хо] if |X— Х| < ô. 
Compare this with Lemma 6.2.6. 


Prove: If L : R” — R” is defined by L(X) = A(X), where A is nonsingular, then 
1 
IL(X) - L(Y)| = ттт -Y| 
А | 


for all X and Y in R”. 


Use Theorem 6.2.8 to find H'(Uo), where H(U) = F(G(U). Check your results by 
expressing H directly in terms of U and differentiating. 


w COS u sin v 


x24 y 
(a) F(x,y,z) = 2 ,  С(и, о, ш) = wsinusinvu |, Ug = 
EA w COS V 
(1/2, 2/2, 2) 
£m v COS u 
(b) FG, у) = y , Glu, v) = | , Uo = (1/4,3) 
B v sinu 
x 
3x + 4y +25 + 6 u— v 
(c) Е(х,у,2) = | 4x-2y * z-1 |, Gu,v)=| ut v |, 
-x+ y+ z-2 u — 2v 


Ubo arbitrary 
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@ Foy =[ 153]. eso - | 22"). was» 
2 2 и 
© re»-[ t5 |. eo m. |, %=@® 
x+2y 
2 
(f) Е(х,у) = | x-y? |, со 57 |, Uo = (1, 22) 
x? + у 


21. Suppose that F апа С are continuously differentiable оп R”, with values in К”, and 
let Н = Fo G. Show that 


Q(hi, h2,..., hn) _ Ilis fo... Sn) 0(g1. 2. .... n) 


(ита, анаа н). (X1, X2,- --, Xn) OUL, U2,- -, Un) 
Where should these Jacobians be evaluated? 


22. Suppose that F : R” — R” and X is a limit point of Dp contained in Dg. Show 
that F is continuous at X if and only if limg_..9 F(X;) = F(X) whenever {Хд} is a 
sequence of points in Dy such that limp... Хк = X. HINT: See Exercise 5.2.15. 


23. Suppose that F : R” — R” is continuous on a compact subset 5 of IR". Show that 
F(S) is a compact subset of R”. 


6.3 THE INVERSE FUNCTION THEOREM 


So far our discussion of transformations has dealt mainly with properties that could just as 
well be defined and studied by considering the component functions individually. Now we 
turn to questions involving a transformation as a whole, that cannot be studied by regarding 
it as a collection of independent component functions. 


In this section we restrict our attention to transformations from IR" to itself. It is useful 
to interpret such transformations geometrically. If F = (fi, fo,..., fn), we can think of 
the components of 


F(X) = (AA), f2(X). .... aX) 
as the coordinates of a point = F(X) in another “copy” of R”. Thus, U = (u1,u2,..., Un), 
with 
ui = fi (X), и? = hX), roki Un = fa). 


We say that F maps X to U, and that U is the image of X under F. Occasionally we will 
also write ди; /дх; to mean 0f;/dx;. If S C Dr, then the set 


F(S) = {U|U = F(X), Xe 5] 


is the image of S under F. 


We will often denote the components of X by x, y, ..., and the components of U by u, 
Uso: 
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Example 6.3.1 If 


2 2 
HESSEN 


then 
u = fix, y) = х? + у?, v = h(x, y) = х^— у?, 
and 
др (х, ор (х, 
их(х, y) = тер = 2х, шух, у) = DD = 2y, 
f(x, Qf» (x, 


To find F(R?), we observe that 
ифо = 2х2, u-—v-2y?, 


so 
F(R?) CT = {(u,v)|u tv >0,u—v> 0}, 
which is the part of the wv-plane shaded in Figure 6.3.1. If (u, v) € T, then 


(RSS 


so F(R?) = T. 


и-у= 0 


и+у= 0 


Figure 6.3.1 
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Invertible Transformations 


A transformation F is one-to-one, or invertible, if F(X) and F(X2) are distinct whenever 
X, and X» are distinct points of Drp. In this case, we can define a function С on the range 


R(F) = {U | U = F(X) for some X € Dp} 
of F by defining G(U) to be the unique point in Dp such that F(U) = U. Then 
Dg = R(F) and R(G) = Dr. 
Moreover, G is one-to-one, 
G(F(X)) =X, Xe Dr, 


and 
F(G(U)) = U, Ue De. 


We say that G is the inverse of F, and write G = F~!. The relation between F and G is 
symmetric; that is, F is also the inverse of G, and we write F = G-!. 


Example 6.3.2 The linear transformation 


u | d x-y 
[== 233 | (6.3.1) 
maps (x, y) to (u, v), where 
и=х- у, 
ENS (6.3.2) 


L is one-to-one and R(L) = R?, since for each (u, v) in К? there is exactly one (x, y) 
such that L(x, y) — (u, v). This is so because the system (6.3.2) can be solved uniquely 
for (x, y) in terms of (u, v): 


oS i(u + v), 
i (6.3.3) 
y = =(-и +v). 
Thus, 
= 1 uv 
1 зш 
L (u,v) = ;| НЕТ |. 
Example 6.3.3 The linear transformation 
и | _ х+ у 
| v ]-ne»- | 2х +2у | 
maps (x, y) onto (u, v), where 
ore (6.3.4) 


v =2x +2y. 
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Lı is not one-to-one, since every point on the line 
х + у = с (constant) 


is mapped onto the single point (c, 2c). Hence, Lı does not have an inverse. ш 


The crucial difference between the transformations of Examples 6.3.2 and 6.3.3 is that 
the matrix of L is nonsingular while the matrix of Lj is singular. Thus, L (see (6.3.1)) can 


be written as 
u 1 -1 x 
НЕЕ SIMI e) 


where the matrix has the inverse 


1 1 
2 2 
—i 1 
2 2 


(Verify.) Multiplying both sides of (6.3.5) by this matrix yields 


l 
2 


| 

I= 

l= юе 

r—34 
о х 

o i 
Il 

r—34 

У ы 

o i 


which is equivalent to (6.3.3). 


Since the matrix 
1 1 
2 2 


of L; is singular, (6.3.4) cannot be solved uniquely for (x, y) in terms of (u, v). In fact, it 
cannot be solved at all unless v = 2u. 


The following theorem settles the question of invertibility of linear transformations from 
IR" to R". We leave the proof to you (Exercise 6.3.2). 


Theorem 6.3.1 The linear transformation 
U=L(X) = АХ (R” >R”) 
is invertible if and only if A is nonsingular, in which case R(L) = R" and 


L !(U-A'!U. 


Polar Coordinates 


We will now briefly review polar coordinates, which we will use in some of the following 
examples. 


The coordinates of any point (x, y) can be written in infinitely many ways as 


x=rcos#é, y=rsin0, (6.3.6) 
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where 


г2 = х2 4 y? 


and, if r > 0, 0 is the angle from the x-axis to the line segment from (0, 0) to (x, y), 
measured counterclockwise (Figure 6.3.2). 


(x, y) 


>x 


Figure 6.3.2 


For each (x, y) 4 (0,0) there are infinitely many values of 0, differing by integral 
multiples of 2л, that satisfy (6.3.6). If Ө is any of these values, we say that 0 is an argument 
of (x, y), and write 

0 = arg(x, y). 


By itself, this does not define a function. However, if ¢ is an arbitrary fixed number, then 
0 = аго(х, у), ф<0 <ф + 2л, 
does define a function, since every half-open interval [ф, ф + 2л) contains exactly one 


argument of (x, y). 


We do not define arg(0, 0), since (6.3.6) places no restriction on 0 if (x, y) — (0,0) and 
therefore r = 0. 


The transformation 


р Vx? + y? 
[;]=в®»= ‚ $ <агр(х,у) <ф-+Е2л, 
arg(x, y) 


is defined and one-to-one on 


De = {(х, у) | (х,у) # (0,0), 


and its range is 
RG) = {(7,9) |r » 0,9 x6 « 9 42x). 
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For example, if ¢ = 0, then 
J2 
GL1)-2|, 


4 


since л /4 is the unique argument of (1, 1) in [0, 27). Еф = л, then 


J2 


9л 
4 


G(1,1) = 


, 


since 9л /4 is the unique argument of (1, 1) in [z, 37). 

If arg(xo, yo) — 4, then (xo, yo) is on the half-line shown in Figure 6.3.3 and G is 
not continuous at (xo, yo), since every neighborhood of (xo, yo) contains points (x, y) for 
which the second component of G(x, y) is arbitrarily close to ф + 27, while the second 
component of G(xo, yo) is ф. We will show later, however, that G is continuous, in fact, 
continuously differentiable, on the plane with this half-line deleted. 


(Xo Yo) 


Figure 6.3.3 


Local Invertibility 


A transformation F may fail to be one-to-one, but be one-to-one on a subset S of Dy. By 
this we mean that F(X,) and F(X2) are distinct whenever X, and X» are distinct points of 
S. In this case, F is not invertible, but if Fs is defined on S by 


Fs(X) = F(X), Xes, 


and left undefined for X d S, then Fs is invertible. We say that Fs is the restriction of F 
to S, and that F;! is the inverse of F restricted to S. The domain of E. is F(S). 
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If F is one-to-one on a neighborhood of Xo, we say that F is locally invertible at Xo. If 
this is true for every Xo in a set S, then F is locally invertible on S. 


Example 6.3.4 The transformation 


u x? — у? 
| ў ]- re» =| 25у | (6.3.7) 
is not one-to-one, since 
F(—x, —y) = F(x, у). (6.3.8) 


It is one-to-one on S if and only if S does not contain any pair of distinct points of the form 
(хо, уо) and (—хо, —yo); (6.3.8) implies the necessity of this condition, and its sufficiency 
follows from the fact that if 


F(xi, yi) = Е(хо, уо), (6.3.9) 
then 
(х1, y1) = (хо, yo) ог (xi. y1) = (—X0, —»o). (6.3.10) 
To see this, suppose that (6.3.9) holds; then 
хр Yt = XO — YO (6.3.11) 
and 
X1y1 = Хоуо. (6.3.12) 


Squaring both sides of (6.3.11) yields 


x} —2xpyp + yr = хр — 2х0у0 + уд. 


This and (6.3.12) imply that 


хі x9 = Yo — У. (6.3.13) 
From (6.3.11), " > : А 
Xi — X9 = у — Yo- (6.3.14) 


Factoring (6.3.13) yields 
(xt хо)? + х0) = (у0 — YO + 02). 
If either side of (6.3.14) is nonzero, we can cancel to obtain 
хі + xo = —YO — у], 


which implies that хо = xı = yo = yı = 0, so (6.3.10) holds in this case. On the other 
hand, if both sides of (6.3.14) are zero, then 


xı = Ехо, yı = yo. 


From (6.3.12), the same sign must be chosen in these equalities, which proves that (6.3.8) 
implies (6.3.10) in this case also. 
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We now see, for example, that F is one-to-one on every set S of the form 
S = {(x, y) | ax + by > 0}, 


where a and b are constants, not both zero. Geometrically, S is an open half-plane; that is, 
the set of points on one side of, but not on, the line 


ax t by = 0 


(Figure 6.3.4). Therefore, F is locally invertible at every Xo # (0,0), since every such 
point lies in a half-plane of this form. However, F is not locally invertible at (0, 0). (Why 
not?) Thus, F is locally invertible on the entire plane with (0, 0) removed. 


(a, b) 


Figure 6.3.4 


It is instructive to find F;! for a specific choice of S. Suppose that S is the open right 
half-plane: 
5 = {(x,y)| x > 0). (6.3.15) 


Then F(S) is the entire uv-plane except for the nonpositive и axis. To see this, note that 
every point in S can be written in polar coordinates as 


х= ғгсоѕ0, y=rsind, r0, -5 <0<. 


Therefore, from (6.3.7), F(x, y) has coordinates (u, v), where 


u = x? — y? = r?(cos? 0 — sin? 0) = r° cos 26, 


v = 2xy = 2r? cos0 sin0 = г? sin20. 
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Every point in the uv-plane can be written in polar coordinates as 
u=pcosa, v=psina, 


where either р = 0 or 


р= уи? +02 > 0, -xxac«m, 


апа the points for which р = О ora = —7 are of the form (и, 0), with и < 0 (Figure 6.3.5). 
If (u, v) = F(x, y) for some (x, y) in S, then (6.3.15) implies that o > 0 and —r <a < 
z. Conversely, any point in the uv-plane with polar coordinates (p, o) satisfying these 
conditions is the image under F of the point 


(х, y) = (o? cosa/2, pl? sina/2) є S. 
Thus, 
(и? + v2)!/^ cos(arg(u, v)/2) 


Fs (и, v) = , -—m <arg(u,v) < m. 
(и? + v?)!/4 sin(arg(u, v)/2 


Figure 6.3.5 


Because of (6.3.8), F also maps the open left half-plane 
51 = {(x, у) |x < 0} 
onto Е(5), and 


(и? + v?)!/4 cos(arg(u, v)/2) 
Fs! (и, v) = ‚ m <arg(u,v) < Зл, 
(u? + v?)!/4 sin(arg(u, v)/2) 


= —Fs!(u, v). 
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Example 6.3.5 The transformation 


и | _ | ех соѕу 
| 7 | = F(x, y) = | Bb guy | (6.3.16) 
is not one-to-one, since 
F(x, y + 2л) = F(x, y) (6.3.17) 


if k is any integer. This transformation is one-to-one on a set 5 if and only if S does not 
contain any pair of points (xo, yo) and (xo, yo + 2Ё л), where k is a nonzero integer. This 
condition is necessary because of (6.3.17); we leave it to you to show that it is sufficient 
(Exercise 6.3.8). Therefore, for example, F is one-to-one on 


So = (6, y)| -œ «x «oo ó xy « $ - 2x] (6.3.18) 


where ф is arbitrary. Geometrically, S; is the infinite strip bounded by the lines у = $ and 
y = ф + 2л. The lower boundary is in Sọ, but the upper is not (Figure 6.3.6). Since every 
point is in the interior of some such strip, F is locally invertible on the entire plane. 


>x 


Figure 6.3.6 


The range of Fs, is the entire uv-plane except the origin, since if (u, v) # (0, 0), then 
(u, v) can be written uniquely as 


u | [| pcosa 
v | | psina |’ 


p>0, фха<ф +2л, 


where 


so (u, v) is the image under F of 
(x, y) = (logp.a) € S. 
The origin is not in R(F), since 


[F(x, y)? = (e* cos y? + (е? sin у)? = e?* £0. 
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Finally, 


log(u? + v2)!/? 
Fs, (и, v)= , o<arg(u,v) < ф + 2л. 
arg(u, v) 


The domain of FS is the entire uv-plane except for (0, 0). 


Regular Transformations 


The question of invertibility of an arbitrary transformation F : IR" — R” is too general to 
have a useful answer. However, there is a useful and easily applicable sufficient condition 
which implies that one-to-one restrictions of continuously differentiable transformations 
have continuously differentiable inverses. 


To motivate our study of this question, let us first consider the linear transformation 


11 ајд 77 din X1 

421 422 © An X2 
F(X) = AX = 

аһ n2 ‘`` Ann Xn 


From Theorem 6.3.1, F is invertible if and only if A is nonsingular, in which case R(F) = 
IR" and 
F`! (U) = A™! U. 


Since A and А! are the differential matrices of F and F^! , respectively, we can say that a 
linear transformation is invertible if and only if its differential matrix F’ is nonsingular, in 
which case the differential matrix of F~! is given by 


(Е!) = (F)'! { 


Because of this, it is tempting to conjecture that if F : R" — IR" is continuously differen- 
tiable and A'(X) is nonsingular, or, equivalently, JF(X) Æ 0, for X in a set S, then F is 
one-to-one on S. However, this is false. For example, if 


F(x,y) = | ех cos y 1. 


ех sin у 


еп 
ех соѕу -—e*siny 


= e*siny  e*cosy 


| = е2* £0, (6.3.19) 


but Е is not one-to-one on R? (Example 6.3.5). The best that can be said in general is 
that if F is continuously differentiable and JF(X) 5 0 in an open set S, then F is locally 
invertible on S, and the local inverses are continuously differentiable. This is part of the 
inverse function theorem, which we will prove presently. First, we need the following 
definition. 
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Definition 6.3.2 A transformation F : R” — R” is regular on an open set S if F is 
one-to-one and continuously differentiable on S, and JF(X) 4 0 if X є S. We will also 
say that F is regular on an arbitrary set S if F is regular on an open set containing S. 


Example 6.3.6 If 


(Example 6.3.2), then 
] -1 
тоу) || TED 


so F is one-to-one on IR7. Hence, F is regular on R2. 
If 


(Example 6.3.3), then 
JF(x, y) = | 


so F is not regular on any subset of R?. 


If е 
X — 
F(x, y) = | 8. | 


(Example 6.3.4), then 


2x —2у 


= 2 2 
2y 2x = 2(x +y ) 


JF(x, y) — | 


so F is regular on any open set S on which F is one-to-one, provided that (0, 0) ¢ S. For ex- 
ample, F is regular on the open half-plane tx; y) | x> 0}, since we saw in Example 6.3.4 
that F is one-to-one on this half-plane. 


If 
_ | e*cosy 
EGY) = | e* соз у | 


(Example 6.3.5), then JF(x, у) = e?* (see (6.3.19)), so F is regular оп any open set on 
which it is one-to-one. The interior of Sg in (6.3.18) is an example of such a set. 


Theorem 6.3.3 Suppose that F : R" — R" is regular on an open set S, and let 
G= F;!. Then F(S) is open, G is continuously differentiable on F(S), and 


G(U) 2(F(X) !, where U = F(X). 


Moreover, since G is one-to-one on F(S), G is regular on F(S). 
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Proof We first show that if Хо € S, then a neighborhood of Е(Хо) is in F(S). This 
implies that F(S) is open. 


Since S is open, there is a р > 0 such that В,(Хо) C 5. Let B be the boundary of 
В (Xo); thus, 
B = (| X] IX - Xo] = p. (6.3.20) 
The function 
о(Х) = |F(X) — F(Xo)| 


is continuous on S and therefore on B, which is compact. Hence, by Theorem 5.2.12, there 
is a point X, in B where o (X) attains its minimum value, say т, on B. Moreover, m > 0, 
since X, Z Xo and F is one-to-one on S. Therefore, 


|F(X) - F(X9)| * m » 0 if |X— Xo| =p. (6.3.21) 


The set 
{U | |U - F(X9)| < m/2} 


is a neighborhood of F(Xo). We will show that it is a subset of F(S). To see this, let U be 
a fixed point in this set; thus, 
|U — F(X9)| < m/2. (6.3.22) 
Consider the function 
o1(X) = |U – F(X)?, 
which is continuous on S. Note that 


m? 


01(Х) > T if |X—Xo| =p, (6.3.23) 
since if |X — Хо| = p, then 


|U — F(X)| = |(U— Е(Хо)) + (F(Xo) — Е(Х))| 
> ||F(Xo) — F(X)| – |U — F(Xo)|| 
m m 

> m — — = —, 

ui 2 2 
from (6.3.21) and (6.3.22). 

Since o, is continuous on 5, o, attains a minimum value jz on the compact set B5(Xo) 

(Theorem 5.2.12); that is, there is an X in B (X9) such that 


oX) 2 1(Х) =p, X € Bj(Xo). 


Setting X = Xo, we conclude from this and (6.3.22) that 


o1(X) = и < 01 (X0) < FX 


Because of (6.3.20) and (6.3.23), this rules out the possibility that Хє В, ѕоХ є B (Xo). 
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Now we want to show that u = 0; that is, U = F(X). To this end, we note that о (X) 
can be written as 


aX = Soy — f; (Y. 
j=1 


so 0, is differentiable on B5 (Xo). Therefore, the first partial derivatives of тү are all zero 


at the local minimum point X (Theorem 5.3.11), so 


(uj — 0) 20, 1<i<n, 


Э af; (X) 
г OX; 
Ј=1 
ог, in matrix form, 
F'(X)(U — Е(Х)) = 0. 


Since F'(X) is nonsingular this implies that U = F(X) (Theorem 6.1.13). Thus, we have 
shown that every U that satisfies (6.3.22) is in F(S). Therefore, since Xo is an arbitrary 
point of S, F(S) is open. 


Next, we show that G is continuous on F(S). Suppose that Оо € F(S) and Xo is the 
unique point in S such that F(Xo) = Uo. Since F' (Xo) is invertible, Lemma 6.2.6 implies 
that there is a A > 0 and an open neighborhood N of Xo such that N C S and 


[F(X) – Е(Хо)| x AIX— Хо] if KEN. (6.3.24) 


(Exercise 6.2.18 also implies this.) Since F satisfies the hypotheses of the present theorem 
on N, the first part of this proof shows that F(N) is an open set containing Up = F(Xo). 
Therefore, there is a ô > 0 such that X = G(U) is in N if U € В; (Оо). Setting X = G(U) 
and Хо = G(Uo) in (6.3.24) yields 


|F(G(U)) — F(G(Uo))| > AIG) - G(Uo)| if U € Bs(Uo). 


Since F(G(U)) — U, this can be rewritten as 
1 
IG(U) — G(Uo)| < av —Uo| if Ue Bs(Uo), (6.3.25) 


which means that G is continuous at Оо. Since Up is an arbitrary point in F(S), it follows 
that G is continous on F(S). 


We will now show that G is differentiable at Up. Since 
С(Е(Х)) =X, Xes, 
the chain rule (Theorem 6.2.8) implies that if G is differentiable at Uo, then 


G'(Uo)F' (Xo) = I 
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(Example 6.2.3). Therefore, if G is differentiable at Uo, the differential matrix of G must 
be 
G'(Uo) = [F(Xo)] '. 


so to show that G is differentiable at Up, we must show that if 


G(U) — G(Uo) - [F(X9)] (U – Uo) 


nm |U — Uo] 


(U £ Uo), (6.3.26) 


then 
lim H U = 0. 6.3.27 


Since F is one-to-one on $ and F(G(U)) = U, it follows that if U 4 Uo, then G(U) 4 
G(Uo). Therefore, we can multiply the numerator and denominator of (6.3.26) by |G(U) — 
G(Uo)| to obtain 


H(U) — 


1600) — Go| [ GU) — G(Uo) – [F'(Xo)] (U — Uo) 
|U — U,| IG(U) — G(Uo)| 


ва) -GUD у ура (U- Uo - F'(oXG(U) - GU») 
-—qm-u 9) ( IG) - Go) ) 


if 0 < |U — Uo| < 8. Because of (6.3.25), this implies that 


1 U — Up — F'(Xo9)(G(U) — GU 
HO) = lI XI" | [ee ци 


|G(U) — G(Uo)| 
if 0 < |U — Uo| < ô. Now let 


U — Uo — F’ (Xo) (G(U) — G(U 
H, (U) = o = F(X9)(G(U) — G(Uo)) 
|G(U) — G(Uo)| 
To complete the proof of (6.3.27), we must show that 
lim H,(U) = 0. (6.3.28) 
U—Uo 
Since Е is differentiable at Xo, we know that if 


F(X) — F(Xo) — F'(Xo)(X — Xo) 


H(X) = li 
2( ) хх, [X — Xo| 


then 
a H5(X) = 0. (6.3.29) 
Since F(G(U)) = U and Xp = G(Uo), 


Hı (U) = H;(G(U)). 
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Now suppose that € > 0. From (6.3.29), there is a 6; > 0 such that 
|Ho(X)|<e if O<|X—Xo| = |X — G(Uo)| < 61. (6.3.30) 
Since G is continuous at Uo, there is a 52 € (0, 5) such that 
IG(U) – G(Uo)| <; if 0 «[U—Uo| < ô2. 
This and (6.3.30) imply that 
ІН; (U)| = ]JH2(G(U)| <e if O<|U—Up| <. 


Since this implies (6.3.28), G is differentiable at Xo. 


Since Ug is an arbitrary member of F(N), we can now drop the zero subscript and 
conclude that G is continuous and differentiable on F(N), and 


G(U) -[F(X] !, UcF(N). 


To see that G is continuously differentiable on F(N), we observe that by Theorem 6.1.14, 
each entry of G'(U) (that is, each partial derivative 0g;(U)/du;, 1 < i, j < n) can be 
written as the ratio, with nonzero denominator, of determinants with entries of the form 


070600). 


3.31 
Эх, (6.3.31) 


Since ðf, / 0x; is continuous on № and G is continuous on F(N), Theorem 5.2.10 implies 
that (6.3.31) is continuous on F(N). Since a determinant is a continuous function of its 
entries, it now follows that the entries of G'(U) are continuous on F(N). E 


Branches of the Inverse 


If F is regular on an open set S, we say that Fy is a branch of Е. (This is a convenient 
terminology but is not meant to imply that F actually has an inverse.) From this definition, 
it is possible to define a branch of F ! ona set T C R(F) if and only if T = F(S), where 
F is regular on S. There may be open subsets of R(F) that do not have this property, and 
therefore no branch of F^! can be defined on them. It is also possible that T = F(S1) = 
F(S5), where S, and S5 are distinct subsets of Dp. In this case, more than one branch of 
F^! is defined on T. Thus, we saw in Example 6.3.4 that two branches of F^! may be 
defined on a set T. In Example 6.3.5 infinitely many branches of F^! are defined on the 
same set. 


It is useful to define branches of the argument To do this, we think of the relationship 
between polar and rectangular coordinates in terms of the transformation 


| : | = F(r, 0) = | ы |! (6.3.32) 


r ѕіп Ө 


where for the moment we regard r and Ө as rectangular coordinates of a point in an r8- 
plane. Let S be an open subset of the right half of this plane (that is, 5 C {(r, 0) | r> 0) 
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that does not contain any pair of points (r, 0) and (r, 9-+2kz), where k is a nonzero integer. 
Then F is one-to-one and continuously differentiable on S, with 


А _ | cos@ —rsiné 
E (,0) = | sinÜ  rcosÓ | (6.3.33) 
and 
JEC, 0 =r >0, (^0) є 8. (6.3.34) 


Hence, F is regular on S. Now let T = F(S), the set of points in the xy-plane with 
polar coordinates in S. Theorem 6.3.3 states that T is open and Fs has a continuously 
differentiable inverse (which we denote by G, rather than F31, for typographical reasons) 


НЕСЕ УЕ, 
args (х, y) 


where args (x, y) is the unique value of arg(x, y) such that 


(7,0) = (v + y?, args (x, ») є S. 


We say that args (x, y) is a branch of the argument defined on T. Theorem 6.3.3 also 
implies that 


zi cosÜ  sinO 
G'(x,y) = [F (r, 8)] =| sin Ө cosé (see (6.3.33)) 
r r 


x y 
ух? 3 У VX FEY | (see (6.3.32). 


x2 + y2 х2 + y? 


Therefore, 


бшу X . QUESO. o (6.3.35) 
dx х +)? ду х2 + у? 

A branch of arg(x, у) сап be defined on an open set Т of the xy-plane if and only if 
the polar coordinates of the points in T form an open subset of the r0-plane that does not 
intersect the 0-ахіѕ or contain any two points of the form (r, 0) and (r, 0 + 2kz), where 
k is a nonzero integer. No subset containing the origin (x, y) = (0, 0) has this property, 
nor does any deleted neighborhood of the origin (Exercise 6.3.14), so there are open sets 
on which no branch of the argument can be defined. However, if one branch can be defined 
on Т, then so can infinitely many others. (Why?) All branches of arg(x, y) have the same 
partial derivatives, given in (6.3.35). 
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Example 6.3.7 The set 
T= {(х, у) | (х,у) Z (x,0) with x> 0}, 


which is the entire xy-plane with the nonnegative x-axis deleted, can be written as Т = 
F(S;,), where F is as in (6.3.32), k is an integer, and 


Sk = ((r.0) |r > 0, 2kx < 0 < 2k +1)z}. 


For each integer k, we can define a branch arg s, (X. Y) of the argument in S; by taking 
args, (x, y) to be the value of arg(x, y) that satisfies 


2кл < args, (x, y) < 2(k + 1)л. 


Each of these branches is continuously differentiable in T', with derivatives as given in 
(6.3.35), and 


args, (x, y) — args, (x, y) = 2(k — Ј)л, (x,y) €T. 


Example 6.3.8 Returning to the transformation 


u | o xu y 
MEC Dey | 


we now see from Example 6.3.4 that a branch G of F^! can be defined on any subset Т of 
the uv-plane on which a branch of arg(u, v) can be defined, and G has the form 


3 (и? + v2)!/^ cos(arg(u, v)/2) 
| | =a) = net, (63.36) 
y (и? + v2)!/^ sin(arg(u, v)/2) 


where arg(u, v) is a branch of the argument defined on T. If С, and С» are different 
branches of F^! defined on the same set T, then б, = +С». (Why?) 


From Theorem 6.3.3, 


—1 
G'(u, v) = [Foy] = | | go | 


"EE. х y 
202 +52) | -y x | 
Substituting for х and у in terms of м and v from (6.3.36), we find that 


Ox ду X 1 
m ec 2035 = 2a v» cos(arg (м, v)/2) (6.3.37) 


and 
дх ду у 


1 А 
a a 20945 = Mak v» sin(arg(u, v)/2). (6.3.38) 


It is essential that the same branch of the argument be used here and in (6.3.36). ш 
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We leave it to you (Exercise 6.3.16) to verify that (6.3.37) and (6.3.38) can also be 
obtained by differentiating (6.3.36) directly. 


u | _ | e*cosy 
| v | ие | e* sin у | 
(Example 6.3.5), we can also define a branch G of F^! on any subset T of the uv-plane on 
which a branch of arg(u, v) can be defined, and G has the form 


| * | zd v) = | log(u? + v?) | (6.3.39) 


Example 6.3.9 If 


y arg(u, v) 


Since the branches of the argument differ by integral multiples of 27x , (6.3.39) implies that 
if G, and С» are branches of F~!, both defined on T, then 


Gs) Ges) = | BA | Пашы). 


From Theorem 6.3.3, 


І -1 
e*cosy -—e*siny 
e*siny  e*cosy 


G'(u, v) = [F' (x. yy = | 


_ е *cosy e *siny 
|». | -e*siny e-*cosy |’ 


Substituting for x and y in terms of u and v from (6.3.39), we find that 


дх ду _ = u 

uci eu Exc “кесу се 
апа 

дх ду e: RUE U 

—=-— = e” siny = e€ ^y--———. 

Qv ди y и? + v? 


The Inverse Function Theorem 


Examples 6.3.4 and 6.3.5 show that a continuously differentiable function F may fail to 
have an inverse on a set S even if /Е(Х) 5 О on S. However, the next theorem shows that 
in this case F is locally invertible on S. 


Theorem 6.3.4 (The Inverse Function Theorem) Let F : R” > R” be 
continuously differentiable on an open set S, and suppose that JF(X) 4 0 оп S. Then, if 
Xo € S, there is an open neighborhood N of Xo on which F is regular. Moreover, E(N) 
is open and G — Fy is continuously differentiable on F(N), with 


GU) = [Е'0Х)| (where U= F(X), Ue F(N). 
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Proof Lemma 6.2.6 implies that there is an open neighborhood N of Xo on which F is 
one-to-one. The rest of the conclusions then follow from applying Theorem 6.3.3 to F on 
N. a 


Corollary 6.3.5 ГЕ is continuously differentiable on a neighborhood of Xo and JF (Xo) # 
0, then there is an open neighborhood М of Xo on which the conclusions of Theorem 6.3.4 


hold. 


Proof By continuity, since JF’(Xo) Æ 0, JF (X) is nonzero for all X in some open 
neighborhood S of Хо. Now apply Theorem 6.3.4. E 


Example 6.3.10 Let Xo = (1,2, 1) and 


u x+y+(z-1? +1 
v | =F(x,y,z) =| y+z+(x-1)}-1 
w z+x+ (у – 2)2 +3 
Then 
1 1 2z—2 
F(x, y,z)= | 2x-2 1 
1 2y-4 
so 


110 
FFX) =|0 I 1 |=2, 
10 1 


In this case, it is difficult to describe N or find G — Fy explicitly; however, we know that 
F(N) is a neighborhood of Up = F(Xo) = (4, 2, 5), that G(Uo) = Xo = (1,2, 1), and 


that 
—1 


1 1 0 1 1 -1 
G(U)-[F(X)] =| 0 1 1 -3| ! 1-1 
1 0 1 — 1 
Therefore, 
1 1 = —4 
GU) = | 2 |+- — v—2 |+E(U), 
2 
1 — —5 
where 
2 E(U) 
in -—————————=0 
U>(4,2,5) J(u – 4)2 + (v — 2) + (w — 5)? 
thus we have approximated G near Up = (4, 2, 5) by an affine transformation. ш 


Theorem 6.3.4 and (6.3.34) imply that the transformation (6.3.32) is locally invertible 
on $ = {(r, 0) | r> 0}, which means that it is possible to define a branch of arg(x, y) ina 
neighborhood of any point (хо, уо) = (0, 0). It also implies, as we have already seen, that 
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the transformation (6.3.7) of Example 6.3.4 is locally invertible everywhere except at (0, 0), 
where its Jacobian equals zero, and the transformation (6.3.16) of Example 6.3.5 is locally 
invertible everywhere. 


6.3 Exercises 


1. Prove: If F is invertible, then F~! is unique. 
2. Prove Theorem 6.3.1. 


3. Prove: The linear transformation L(X) — AX cannot be one-to-one on any open set 
if A is singular. HINT: Use Theorem 6.1.15. 


4. Let 
G(x, y) = | ee | , m/2 < аге(х,у) < 51/2. 
arg(x, y) 
Find 
(a) GO, 1) (b) G(1,0) (c) G(-1,0) 
(d) GQ.,2) (e) G-1,1) 


5. Same as Exercise 6.3.4, except that —2л < arg(x, y) < 0. 


6. (a) Prove: If f : R > R is continuous and locally invertible on (a, b), then f is 
invertible on (a, b). 


(b) Give an example showing that the continuity assumption is needed in (a). 
T. Let 


(Example 6.3.4) and 
S={(x,y)|ax+by>0} (a? +b? 20). 
Find F(S) and Ес. If 
Sı = {(x, у) |ax + by < 0), 


show that F(S;) = F(S) and Е;! = —ЕКу!. 


8. Show that the transformation 


u | _ | e*cosy 
| v | Ei | ех sin y | 
(Example 6.3.5) is one-to-one on any set S that does not contain any pair of points 
(хо, yo) and (xo, yo + 2Кл), where k is a nonzero integer. 


10. 


11. 


12. 


13. 


14. 


Section 6.3 The Inverse Function Theorem 415 


Suppose that F : IR" — IR" is continuous and invertible on a compact set S. Show 
that p; is continuous. HINT: If F5! is not continuous at U in F(S), then there is 


an €o > 0 and a sequence {Ux} in F(S) such that ітд оо Uy = U while 
|F;(U4) -Fs'M| ze. К>1. 


Use Exercise 5.1.32 to obtain a contradiction. 
Find F^! and (F^! y: 


а) |]-xe»-| $17 | 


u —x+y+2z 
(b) v | =F(x,y,z) = | 3xt+y—4z 
w =x — y + 2z 


In addition to the assumptions of Theorem 6.3.3, suppose that all gth-order (q > 1) 
partial derivatives of the components of F are continuous on 5. Show that all qth- 
order partial derivatives of ЕС! are continuous on F(S). 


If 5 Б 
|: [ere »-| $52 | 


(Example 6.3.1), find four branches G1, G5, G3, and G4 of F^! defined on 
Тү = {(и, о) |u - v >0,u—v > 0}, 

and verify that С! (u, v) = (F' (x(u, v), y(u, v)))!, 1 <i <4. 

Suppose that A is a nonsingular n x n matrix and 

5 


X 
U=F(X)=A 


(a) Show that F is regular on the set 
S= (X |eixi >0,1<i <n}, 
where e; = £1,1 <i <n. 
(b) Find F5'(U). (c) Find (F;!)'(U). 
Let 0(x, y) be a branch of arg(x, y) defined on an open set S. 


(a) Show that 0(x, y) cannot assume a local extreme value at any point of S. 

(b) Prove: If a 32 0 and the line segment from (xo, yo) to (axo, ayo) is in S, then 
(ахо, ayo) = Ө(хо, yo). 

(c) Show that S cannot contain a subset of the form 


А= {(х,у)|0 «n s Vt xy! x n). 
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15. 


16. 


17. 


18. 


19. 


20. 
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(d) Show that no branch of arg(x, y) can be defined on a deleted neighborhood 
of the origin. 
Obtain Eqn. (6.3.35) formally by differentiating: 
x y es ВА 
————À b) arg(x, у) = sin ! ———— 
x2 + y? ( ) / х2. + y? 
(c) arg(x, у) = tan! = 
x 


Where do these formulas come from? What is the disadvantage of using any one of 
them to define arg(x, y)? 


и | [х2 = у? 
HELM 


(Example 6.3.4), find a branch G of F^! defined on T — {(u, v) | au + bv > 0}. 
Find G’ by means of the formula G’ (U) = [F’(X)]~! of Theorem 6.3.3, and also by 
direct differentiation with respect to u and v. 


(a) а(х, у) = cos"! 


For the transformation 


A transformation 


v(x, y) 


is analytic on a set S if it is continuously differentiable and 


F(x. y) =| Pa | 


Ux = Uy, Uy = —vx 


on S. Prove: If F is analytic and regular on S, then p is analytic on F(S); that is, 
Xy = uy and xy = —uy. 
Prove: If U — F(X) and X — G(U) are inverse functions, then 


0(01,u2; , Un) Об, Xa Xn). _ 


= 
0(х1, х2,...,Хһ 0(u1,u2, ..., Un) 
Where should the Jacobians be evaluated? 


Give an example of a transformation F : IR" — IR" that is invertible but not regular 
on R”. 


Find an affine transformation A that so well approximates the branch G of F^! 
defined near Up = F(X) that 


G(U) — A(U) 
m ———————— = 
U—Uo [U = Uo| 


4,5 — 
(a) иЕе ж Xo = (1,—1) 


21. 


22. 


23. 
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(b) MEX au |, Xo = (1,1) 


2xy + xy? 
и 2x?y +x? +z 
(c) v | = F(x, у, 2) = x? +yz , X= (0,1,1) 
u X COS y COS Z 
(d) v | =F(x,y,z)= | xsinycosz |, Xo = (1, л/2, л) 
w x sinz 
If F is defined by 
x r cos Ө cos ó 
y |  F(r,0,9) = | rsin0cosó 
2 rsing 


and С is a branch of F-!, find G’ in terms of r, 6, and $. HINT: See Exer- 
cise 6.2.14(b). 
If F is defined by 
r cos 0 
= F(r,0,z) = | rsin 
va 


NS x 


and G is a branch of F-!, find G’ in terms of r, Ө, and z. HINT: See Exer- 
cise 6.2.14(c). 


Suppose that F : R” — IR" is regular on a compact set T. Show that F(dT) = 
дЕ(Т); that is, boundary points map to boundary points. HINT: Use Exercise 6.2.23 
and Theorem 6.3.3 to show that 0F(T) C F(9T). Then apply this result with F and 
T replaced by F ! and F(T) to show that F(9T) C дЕ(Т). 


6.4 THE IMPLICIT FUNCTION THEOREM 


In this section we consider transformations from "+" to R”. It will be convenient to 
denote points in R’*” by 


(X, U) = (x1, X2, ..., Xn, U1, U2, ..., Um). 


We will often denote the components of X by x, y, ..., and the components of U by u, v, 


To motivate the problem we are interested in, we first ask whether the linear system of 
m equations in m + n variables 


а\1Х1 + d12X2 +++ + AinXn + birui + bizuz + +: + bimum = 0 
a21X1 + d22X2 + +++ + donXn + D21u1 + beaux +++: + Ботит = 0 


(6.4.1) 


Ami X1 + dm2X2 + `+: + 4тпХп + ти + bm2u2 +: + bum = 0 
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determines u1, U2, ..., Um uniquely in terms of x1, x5, ..., Xn. By rewriting the system in 
matrix form as 
AX + BU = 0, 
where 
dij ауу © Gin bıı bi c bim 
a21 022 `` ап bai Бо) + bam 
A = ЕЛ В = . , 
ml Ят2 `` атп bmi bm2 c bmm 
X1 ИІ 
X2 u2 
X= . , and U= ! ; 
Xn Um 


we see that (6.4.1) can be solved uniquely for U in terms of X if the square matrix B is 
nonsingular. In this case the solution is 


U--B AX. 
For our purposes it is convenient to restate this: If 
F(X, U) = AX + BU, (6.4.2) 
where B is nonsingular, then the system 
F(X, U) = 0 


determines U as a function of X, for all X in R”. 


Notice that F in (6.4.2) is a linear transformation. If F is a more general transformation 
from R"*? to R”, we can still ask whether the system 


F(X, U) — 0, 
or, in terms of components, 
Л (х1,х2,..., Xn, M1, U2,...,Um) = 0 
ЈЉ(х1,Х2,..., Xn, U1, U2,...,Um) = 0 
Хп (1, Х2,..., Xn, M1, U2, ... Um) = 0, 


can be solved for О in terms of X. However, the situation is now more complicated, even 
if m = 1. For example, suppose that m = 1 and 


fix yu)—lez'-y^-u* 
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If x? + y? > 1, then no value of и satisfies 


f, y,u) = 0. (6.4.3) 
However, infinitely many functions u = u(x, y) satisfy (6.4.3) on the set 
5 = {(х, у) |x? + у? < 1}. 
They are of the form 
u(x, y) = (x, y) 1- x? = y?, 


where €(x, у) can be chosen arbitrarily, for each (x, y) in S, to be 1 or —1. We can narrow 
the choice of functions to two by requiring that u be continuous on S; then 


u(x, y) = y1 -— х2 – y? (6.4.4) 
or 


u(x,y) =—-V1—x2—-y?. 


We can define a unique continuous solution u of (6.4.3) by specifying its value at a single 
interior point of S. For example, if we require that 


1 1 1 
u| ay — | = — 
( УЗ V3 ) V3 
then u must be as defined by (6.4.4). 


The question of whether an arbitrary system 
F(X, U) = 0 


determines U as a function of X is too general to have a useful answer. However, there 
is a theorem, the implicit function theorem, that answers this question affirmatively in 
an important special case. To facilitate the statement of this theorem, we partition the 
differential matrix of F : R"*" — R”: 


дл oft 9fi дл oft afi 
ax: Ox. Әх ди диз дим 
9f; Ə да 9f; Əh 9f 
F=| дх дю дхһ дит диз дит (6.4.5) 


fn Ain Bn, fm fm Mf 


Ox, дхо дхһ Our Ou; дим 


ог 
Е = [Fx, Fy], 
where Fx is the submatrix to the left of the dashed line in (6.4.5) and Fy is to the right. 
For the linear transformation (6.4.2), Fx = A and Fy = B, and we have seen that the 


system F(X, U) = 0 defines U as a function of X for all X in R” if Fy is nonsingular. The 
next theorem shows that a related result holds for more general transformations. 
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Theorem 6.4.1 (The Implicit Function Theorem) Suppose thatF : R"*" > 
R” is continuously differentiable on an open set S of R"*" containing (Xo, Uo). Let 
F(Xo, Uo) = 0, and suppose that Fy (Xo, Uo) is nonsingular. Then there is a neighborhood 
M of (Xo, Uo), contained in S, on which Fy (X, U) is nonsingular and a neighborhood N 
of Xo in R” on which a unique continuously differentiable transformation G : R” — R” 


is defined, such that С(Хо) = Uo and 
(X, G(X) € M and F(X,G(X) =0 if XEN. (6.4.6) 


Moreover, 


G(X) = —[Fu(X, GA) ! Fx(X, G(X), X € М. (6.4.7) 
Proof Define Ф : R"*" — R"*” by 


X1 
X2 
Xn 
Ф(Х,0) = | fA(X,U) (6.4.8) 
Р(Х, О) 
ог, in "horizontal"notation by 
9$ (X, U) = (X, F(X, U)). (6.4.9) 
Then Ф is continuously differentiable on S and, since F(Xo, Uo) = 0, 
9$ (Xo, Uo) = (Хо, 0). (6.4.10) 
The differential matrix of ® is 
1 O e 0 0 0 ... 0 
0 1 0 0 0 0 
0 0 1 0 0 0 
Тал эл AAAA 1 о 
Ф = Ox, дхә Ox, ðu, ди» дит = | Fx Fy |. 
dh th ӘБ th ah ар 
Ox, 0X2 Ox, ðu, ди» Oum 


M Bm Mf dfa Bm Mf 


0x1 0x2 Ox, OU, ди» Oum 
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where I is the n x n identity matrix, 0 is the n x m matrix with all zero entries, and Fx 
and Fy are as in (6.4.5). By expanding det(®’) and the determinants that evolve from it in 
terms of the cofactors of their first rows, it can be shown in n steps that 


дл oft afi 
J® = det(®’) = | ðuı ди» дит | = det(Fy). 


Ma dn hn 


Ju; диг dum 


In particular, 
ЈФ (Хо, Uo) = det(Fu(Xo, Uo) # 0. 


Since 9 is continuously differentiable on S, Corollary 6.3.5 implies that ® is regular on 
some open neighborhood M of (Xo, Оо) and that M = ®(M) is open. 


Because of the form of ® (see (6.4.8) or (6.4.9)), we can write points of M as (X, V), 
where V € R”. Corollary 6.3.5 also implies that ® has a a continuously differentiable 
inverse T (X, V) defined on M with values in M. Since Ф leaves the “X part" of (X, U) 
fixed, a local inverse of Ф must also have this property. Therefore, Г must have the form 


ХІ 
X2 


Xn 
Г (Х, У) = hi(X, V) 


h2 (X, V) 


hys (X, V) 


or, in "horizontal" notation, 
I (X, V) = (X, HX, V)), 
where H : R"*" — R” is continuously differentiable on M. We will show that G(X) = 
H(X, 0) has the stated properties. 
From (6.4.10), (Xo, 0) eM and, since M is open, there is a neighborhood N of Xo in 
IR” such that (X, 0) € M if X € N (Exercise 6.4.2). Therefore, (X, G(X)) = T (X, 0) € M 


if X € N. Since T = 9 !, (X, 0) = Ф(Х, G(X)). Setting X = Xo and recalling (6.4.10) 
shows that G(Xo) = Оо, since Ф is one-to-one on M. 
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Henceforth we assume that X є N. Now, 


(X,0) = (T (X, 0)) (since Ф = T^!) 
= $(X, G(X)) (since T (X, 0) = (X, G(X))) 
—(X,F(X,G(X)) (since 6 (X, U) = (X, F(X, U))). 


Therefore, F(X, G(X)) — 0; that is, G satisfies (6.4.6). To see that G is unique, suppose 
that G; : R” — R” also satisfies (6.4.6). Then 


9(X, G(X)) = (X. F(X, G(X))) = (X. 0) 
and 
9 (X. G (X)) = (X, F(X, G1 (X))) = (Х, 0) 
for all X in N. Since Ф is one-to-one on М, this implies that G(X) = G; (X). 


Since the partial derivatives 


дһ; А : 
=, Т 1<j<n, 
Ox; 


are continuous functions of (X, V) on M, they are continuous with respect to X on the 
subset (X, 0) | XEN } of М. Therefore, С is continuously differentiable on №. To verify 
(6.4.7), we write F(X, G(X)) = 0 in terms of components; thus, 


Fi (1, X2... Xn, 21(X), 82 (Х),...,5.(Х)) = 0, 1xizm, XEN. 


Since f; and g1, 22, ..., gm are continuously differentiable on their respective domains, 
the chain rule (Theorem 5.4.3) implies that 


m 


afi (X, С(Х)) py сыш ЕЮ =0, l<i<m,1<j<n, (6411) 
дх; с. ди, Ox; 
or, in matrix form, 
Fx (X, G(X)) + Fy(X, G(X))G'(X) = 0. (6.4.12) 


Since (X, G(X)) € M for all X in N and Fy(X, U) is nonsingular when (X, U) € M, we 
can multiply (6.4.12) on the left by Fy! (X, G(X)) to obtain (6.4.7). This completes the 
proof. ш 


In Theorem 6.4.1 we denoted the implicitly defined transformation by G for reasons 
of clarity in the proof. However, in applying the theorem it is convenient to denote the 
transformation more informally by U = U(X); thus, U(Xo9) = Uo, and we replace (6.4.6) 
and (6.4.7) by 


(X,U(X) € М and X(X,U(X))=0 if XEN, 


and 
U'(X) = —[Fu(X, U(X)" x(X. U(X), Хел, 
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while (6.4.11) becomes 


ї<ї<т,‚,1<ў<п, (6.4.13) 


Ox; Qu, OX; 


af; +S Afi ди, _ 


it being understood that the partial derivatives of u, and f; are evaluated at X and (X, U(X)), 
respectively. 


The following corollary is the implicit function theorem for m — 1. 


Corollary 6.4.2 Suppose that f : R"*! — R is continuously differentiable on an 
open set containing (Xo, ио), with f (Xo, uo) = О and fy, (Хо, ио) Æ 0. Then there is a 
neighborhood M of (Xo, uo), contained in S, and a neighborhood N of Xo in R” on which 
is defined a unique continuously differentiable function u = u(X) : R" — R such that 
(X,u(X) EM and jf,(X,uX) Z0, XEN, 
u(Xo) = ио, and f(X,u(X))=0, XEN. 


The partial derivatives of u are given by 


00 fx, (X,u(X)) | 
Ux; (X) = “F(X uo)" 1 <і <и. 
Example 6.4.1 Let 
f(x, y u) = 1- x? — у2 — u? 


and (хо, уо, uo) = G, –1, 55). Then f (xo, уо, zo) = 0 and 


Sr, y u) = 2х, fy, у.н) = –2у, М(х, yu) = – 


Since f is continuously differentiable everywhere апа /, (хо, уо, Uo) = —/2 0, Corol- 
lary 6.4.2 implies that the conditions 


1—х2—у2—и®°=0, и(1/2,—1/2)= — 


determine u = u(x, y) near (xo, уо) = (2, –1) so that 
= Аб, y,u(x, y)) = =x 
uS = FG yu) Guy) a 
and 
__ fe yu y) _ —у 
иу(х, у) = Пи) XN ШТУ (6.4.15) 
ш 


It is not necessary to memorize formulas like (6.4.14) and (6.4.15). Since we know that 
f and и are differentiable, we can obtain (6.4.14) and (6.4.15) by applying the chain rule 
to the identity 


f(x, y, u(x, y)) = 0. 
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Example 6.4.2 Let 
f(x; y, u) = уги + 3ху*%и* хуби? + 12x = 13 
and (xo, уо, uo) = (1, —1, 1), so f(xo, уо, uo) = 0. Then 


fal, y, U) = Зх2у2и2 + 3y*u* — 18х5уби? + 12, 
fy(x, y, u) = 2x7 yu? + 12xy?u* — 18x% yu’, 
Ful, y,u) = 2х?у?и + 12хуќи? — 21х6убиб. 


Since f,(1, —1, 1) = —7 ¥ 0, Corollary 6.4.2 implies that the conditions 
f(x,y,u)=0, u(l,—1)= 1 


determine u as a continuously differentiable function of (x, y) near (1, —1). 


(6.4.16) 


(6.4.17) 


If we try to solve (6.4.16) for u, we see very clearly that Theorem 6.4.1 and Corol- 
lary 6.4.2 are existence theorems; that is, they tell us that there is a function u — u(x, y) 
that satisfies (6.4.17), but not how to find it. In this case there is no convenient formula for 
the function, although its partial derivatives can be expressed conveniently in terms of x, 


y, and u(x, y): 


_ у(х, у,и(х,у)) 
DICENTE 


In particular, since u(1, —1) — 1, 


их(х, у) = uy(x, y) = 


4 


0 
ux(1,—1) = “=a =0, uy,(L-1)- ше 


"E. 
"ge 
Example 6.4.3 Let 
* и 
X= y and U= | " 1. 


апа 


2 2 2 2.2 
вк - | ^ РР | 


x? +z? +2u—v 


If Xo = (1, —1, 1) and Up = (0, 2), then F(Xo, Uo) = 0. Moreover, 


кых, =| 4 =| T Fx=| 5 2y x] 


2 -1 2x 0 2z 
So 

0 —4 
det(Fy (Xo, Uo)) = | 2 1 | =8 Æ 0. 


_ Дуб, у,м(х, y) 
Л, y, u(x, y)) 
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Hence, the conditions 
F(X,U) = 0, U(1,—1,1)= (0,2) 


determine U = U(X) near Xo. Although it is difficult to find U(X) explicitly, we can 
approximate U(X) near Xo by an affine transformation. Thus, from (6.4.7), 


U' (Xo) = —[Fu(Xo, U(Xo))] ! Fx (Xo, U(Xo)) (6.4.18) 


eS 


Therefore, 
х—1 
u(x, у) 0 1 42 6 
e» ]-[2]+в —-8 4 -4 ur А 
lim Ж OO oz . m" 
а (= + (у + D? + @- 19]? | 0 | 


Again, it is not necessary to memorize (6.4.18), since the partial derivatives of an implic- 
itly defined function can be obtained from the chain rule and Cramer’s rule, as in the next 
example. 


Example 6.4.4 Letu = u(x, y) and v = v(x, y) be differentiable and satisfy 
х2 + 2y? +327 фи? +v=6 
(6.4.19) 
2x? + 4y? + 222 +u + у? = 9 


апа 
u(1,—1,0) = —1, v(1,—1,0) = 2. (6.4.20) 


To find их and vx, we differentiate (6.4.19) with respect to x to obtain 


2x + 2uux + v = 0 
6x? + их + 200; = 0. 


Therefore, 
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and Cramer’s rule yields 


2x 1 
6x? 2v 6x? — 4xv 
ux —— = 
2и 1 4uv—1 
1 2v 
and 
2u 2x 
1 6x? 2x — 12x?u 
Vx = — = 
2и 1 4uv—1 
] 2v 


if 4uv Æ 1. In particular, from (6.4.20), 


—2 2 14 14 
ux (1, —1,0) = —9 = 9' vx(1, —1,0) = 9 = "gs 


Jacobians 


It is convenient to extend the notation introduced in Section 6.2 for the Jacobian of a trans- 


formation F : IR" — R”. If fi, fo, ..., fm are real-valued functions of k variables, 
k > m, and £1, £2, ..., Em are any m of the variables, then we call the determinant 
0&1 08 д5 
0&1 д д5» 
0&1 08 д5 
the Jacobian of fi, fa, ..., fm with respect to £1, &,..., Em. We denote this Jacobian by 
(fi, Р,..., Jm) 
Осава)" 
and we denote the value of the Jacobian at a point Р by 
ISi, Р, ..., Jm) 
д(@1, 82... Em) |, 


Example 6.4.5 If 


3х2 + 2ху + 22 
F(x, у, 2) = | [б Жш чыр ; 
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then 
0(fi. Р) _| 6x+2y 2x 0(fi. Р) _| 2x 22 
d(x, y) 8х +2y? 4ху д(у. 2) 4ху 322 |” 
апа 
(fi, Р) | 2z 6x+2y 
(zx) - 3z? 8х +2y? 
The values of these Jacobians at Xp = (—1, 1, 0) are 
a(fi, Р) A 2| 985 —2 0|_ 
de» 1-6 417" 39531 0-91 
‚у Xo xe 
and 
Ifi, Р) 0 —4 
=] = = 0. 
0(2, x) 0 —6 ы 
хо 


The requirement in Theorem 6.4.1 that Fy (Xo, Оо) be nonsingular is equivalent to 


O(fi, Р,..., fm) 


0(u1,u2,..., Um) 


#0. 


(Xo, Uo) 
If this is so then, for a fixed j, Cramer's rule allows us to write the solution of (6.4.13) as 


DE fie ose rented fn) 


ОЛ СЕЕ e ay, 
дх; OA, fa +++ Fin ++» Jm) 
O(U1,U2,...,Uj,...,Um) 


Notice that the determinant in the numerator on the right is obtained by replacing the ith 
column of the determinant in the denominator, which is 


af af, 
ди дху 
ЈА аһ 
диг |. by àx; 
Ofm fm 


So far we have considered only the problem of solving a continuously differentiable 
system 
F(X,U) =0 (F:mR"*" > R”) (6.4.21) 
for the last m variables, и, U2, ..., Um, in terms of the first n, x1, X2, ..., Xn. This was 
merely for convenience; (6.4.21) can be solved near (Xo, Uo) for any m of the variables in 
terms of the other n, provided only that the Jacobian of ў, f2, ..., fm with respect to the 
chosen m variables is nonzero at (Xo, Ug). This can be seen by renaming the variables and 
applying Theorem 6.4.1. 
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Example 6.4.6 Let 
fx. у, z) | 
g(x, y. 2) 


be continuously differentiable in a neighborhood of (xo, yo, Zo). Suppose that 


F(x, y,z) = | 


Е(хо, уо, zo) = 0 


and 


9f. 8) 


TES 5 0. (6.4.22) 


(х0,у0,20) 


Then Theorem 6.4.1 with X = (у) апа U = (х, z) implies that the conditions 
fG.y.z)-0, g(x, у,2) = 0, х(уо) = хо, (уо) = 20, (6.4.23) 


determine x and z as continuously differentiable functions of у near yo. Differentiating 
(6.4.23) with respect to y and regarding x and z as functions of y yields 


fax! T fy sr Sez =0 
gxX' + gy + gzz =0. 


Rewriting this as 


Sex! T fez = —fy 
gxX + 2:2 = —gy, 


and solving for x’ and z’ by Cramer’s rule yields 


| - f af, 8) 
„18у 8 | _ 00,2) 
zn a) (6.4.24) 
8х 8z 0(x, 2) 
and 
fx -Љ (7. 8) 
Pol Sx Ey _ 9C y) 
2 = Tuum Pa RD (6.4.25) 
8х 8z a(x, 2) 


Equation (6.4.22) implies that 0( f, g)/0(x, z) is nonzero if y is sufficiently close to yo. 


Example 6.4.7 Let Xo = (1, 1,2) and 


fœ, у, 2) | 
g(x, y. 2) 


_ [ 6x + 6y + 4z3 – 44 


к.) = | cn 
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Then Е(Хо) = 0, 


xS =| 6 12:? 
a(x,z) | 


and 
af g) 
0(х, 2) 


_ 6 48 
NES 8 
(1,1,2) 
Therefore, Theorem 6.4.1 with X = (y) and U = (x, z) implies that the conditions 
fGy.z)-0, gx, у, 2) = 0, 
апа 
x(D =1, z(1) = 2, (6.4.26) 


determine x апа z as continuously differentiable functions of у near уо = 1. From (6.4.24) 
and (6.4.25), 


ICF, в) | 6 122 

zo 30.2) | LÀ» 8 |__2+у@ 
af 8) 6 1222 2-- xz? 
д(х, 2) | —2x 8 

and 

(А, 8) | 6 6 

i OO). j| CARI Ro. 

007. g) 6 1222 4+ 2xz2 
д(х, 2) | —2x 8 | 


These equations hold near y = 1. Together with (6.4.26) they imply that 
x(1) 2-1, z'(1)- 0. 


Example 6.4.8 Continuing with Example 6.4.7, Theorem 6.4.1 implies that the con- 
ditions 


fG.y.z)-0, gGQyz)-0, у() = 1, z(1)=2 


determine y and z as functions of x near xo = 1, since 


AFD) _ | 6 1222 
(У, 2) -2y 8 
and 
8Cf. 8) -| 5 48 [= 144 40. 
д0. 2) (1,1,2) cB 


However, Theorem 6.4.1 does not imply that the conditions 


Р(х, у,2) = 0, g(x, у,2) = 0, х(2) = 1, yQ)=1 
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define x and y as functions of z near zo = 2, since 


fg | 6 6 | 
a(x, y) —2x —2у 
and 
Cf. g) _| 6 6 | = 
WE aaa? qr = и 
We close this section by observing that the functions u1, u2, ..., Um defined in Theo- 


rem 6.4.1 have higher derivatives if f1, f2,..., fm do, and they may be obtained by differ- 
entiating (6.4.13), using the chain rule. (Exercise 6.4.17). 


Example 6.4.9 Suppose that u and v are functions of (x, y) that satisfy 
f(%,y, 4, v) =x—u? —v?4+9=0 


g(x, y,u, v) = у-и? +v*-10=0. 


Then 
д(/, g) —2u —2v 
a ШЕ = —8uv. 
д(и, v) —2u 2v 
From Theorem 6.4.1, if uv Æ 0, then 
мо 139628 | 1]|1 2|. 1 
*  8uvO(x,v) 8uv|O Q2v | 4м” 
- = Pe) LS IEEE I 
?  8uvO(y,v) 8wv|l1 w| ди 
n 19050) |- 1|. 1 
* 8uvO(u,x)  8uv| —2u O| 4v’ 
jon b AE. d pem mL. T 
” < 8ир д(и, у) 8uv| -2U l| 4 


These can be differentiated as many times as we wish. For example, 


_ Uy _ 1 
cog T qur 
Uy 1 
May = Taur = qe 
and 
Ux 1 


74r Tov? 
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6.4 Exercises 


Solve for U = (u,...) as a function of X = (x,...). 


(a) 1 1 u 4 1 —1 x | | 0 
1 -l U 2 —3 y] |0 
u-—v+tw+3x+2y=0 

(b —u+v+w- x+ y=0 
u+v-—w + y=0 


3u+ v+y=sinx 
(c) и + 20 + х = sin 
= siny 


2и +20 + ш+2х +2у + 2 = 0 
(d) u= v+2w+ x— y+2z=0 
Зи +2v— wt+3x+2y-— z=0 


Suppose that Хо є IR" and Up € R”. Prove: If N is a neighborhood of (Xo, Uo) 
іп "+, there is a neighborhood N of Xo in R” such that (X, Uo) € Nj if X є М. 


Let (Xo, Uo) be an arbitrary point in R"*", Give an example of a function F : 
I"*" —. R” such that F is continuously differentiable on R"*", F(Xo, Uo) = 0, 
Fy (Xo, Uo) is singular, and the conditions F(X, U) = 0 and U(Xo) = Yo 


(a) determine U as a continuously differentiable function of X for all X; 

(b) determine U as a continuous function of X for all X, but U is not differentiable 
at Xo; 

(c) do not determine U as a function of X. 


Let u — u(x, y) be determined near (1, 1) by 
x?yu--2xyh? — 3x? y?u? = 0, u(1,1) 5 1. 
Find ux (1, 1) and uy (1, 1). 
Let u — u(x, y, z) be determined near (1, 1, 1) by 
x?y?z^w) + 2xy2u3 — 3x?z2u = 0, u(L 1,1) =1. 


Find и, (1, 1, 1), u, (1, 1, 1), and uz(1, 1, 1). 

Find и(хо, уо), ux (xo. уо), and uy (xo. yo). 

(a) 2x? + y? cue" = 6, (xo, yo) = (1,2) 

(b) wx +1) x( +2) + y@—2)=0, (хо, уо) = C1.-2) 
(c) 1—e"sin(x - y) 20, (xo, yo) = (1/4, 1/4) 

(d) xlogu+ylogx+ulogy=0, (хо, yo) = (1, 1) 
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10. 


11. 


12. 
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Find и(хо, уо), Ux (хо, уо), and uy (xo, yo) for all continuously differentiable func- 
tions u that satisfy the given equation near (xo, yo). 


(a) 2x2y* —3uxy? + u?x*ty? = 0; (хо, уо) = (1, 1) 
(b) cosucosx +sinusiny — 0; (xo, yo) = (0, x) 


Suppose that U = (и, v) is continuously differentiable with respect to (x, у, z) and 


satisfies 
x? + 4у2 + 22 — 2u? + v? = —4 


(x +z)? +u-—v = -3 
and 
u(l,4,—1)= -2, v(1,4,-1) — I. 
Find U'(1, 2, —1). 
Let и and v be continuously differentiable with respect to x and satisfy 
u + 2w? +02 -x^-2v-x-z0 
xuv + e” sin(v +x) = 0 
and u(0) = v(0) = 0. Find u’ (0) and v'(0). 
Let U — (u, v, w) be continuously differentiable with respect to (x, y) and satisfy 
x2y + xy? +u? — (v + wy = —3 


ех+у — u — v — w = —2 
(x+y? +utv+w?= 3 


and U(1, —1) = (1,2, 0). Find U'(1, —1). 


Two continuously differentiable transformations U = (u,v) of (x, y) satisfy the 
system 


хуи — 4yu + 9xv =0 
2xy —3y? +v =0 
near (Xo, Yo) = (1,1). Find the value of each transformation and its differential 


matrix at (1, 1). 


Suppose that и, v, and ш are continuously differentiable functions of (x, y, z) that 
satisfy the system 


ех cos y + e* сози +e” cos w + х = 3 
ех sin y + e? sinu + e" cos w =1 
e* tan y + e% tanu + e” tanw +z = 0 


near (хо, уо, Zo) = (0,0,0), and u(0,0,0) = v(0,0,0) = w(0,0,0) = 0. Find 
ux (0, 0, 0), vx (0, 0, 0), and wx (0, 0, 0). 


13. 


14. 


15. 


16. 


17. 
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Let F = ( f, g, h) be continuously differentiable in a neighborhood of Po = (хо, уо, Zo, “о, vo), 
Е(Ро) = 0, and 
9(/, g. h) 


д(у, 23 и) Ро 
Then Theorem 6.4.1 implies that the conditions 


#0. 


F(x, у, 2,и,0) = 0, y(xo,vo)-— uo, (х0, 00) = Zo, U(Xo0, 00) = uo 


determine у, z, and и as continuously differentiable functions of (х, v) near (xo, vo). 
Use Cramer’s rule to express their first partial derivatives as ratios of Jacobians. 


Decide which pairs of the variables x, y, z, u, and v are determined as functions of 
the others by the system 


x+2y+3z+ u+6v=0 
2x+4y+ z+2u+2v=0, 


and solve for them. 
Let y and v be continuously differentiable functions of (x, z, u) that satisfy 
x? + dy? + 22 —2u? + v? = —4 
(x+z)? +u-—v=-3 


near (xo, zo, uo) = (1, —1, —2), and suppose that 
1 
у(1,—1,—2) = 7 v(1,—1,—2)= I. 


Find ух(1,—1,—2) and v, (1, —1, —2). 
Let u, v, and x be continuously differentiable functions of (w, y) that satisfy 
xy + xy? +u — (0+ ш)? = —3 
ety —y—v—w=-2 
(х+у)*+и+ъ+ш?= 3 


near (wo, yo) = (0, —1), and suppose that 
u(0,—1)= 1, v(0,51)22, x(0,—1)— I. 


Find the first partial derivatives of и, v, and x with respect to y and ш at (0, —1). 


In addition to the assumptions of Theorem 6.4.1, suppose that F has all partial 
derivatives of order < q in S. Show that U = U(X) has all partial derivatives 
of order < q in N. 
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Calculate all first and second partial derivatives at (xo, yo) = (1, 1) of the functions 
u and v that satisfy 


x? +y? +u +02 =3 
E Е и(1,1) 20, (1,1)=1. 
Calculate all first and second partial derivatives at (xo, yo) = (1, —1) of the func- 
tions и and v that satisfy 

w—v=x-y-2 


Quy =x + y-2, и(1,-1) 2-1, w(1,-1)-l. 


Suppose that fi, f2, ..., fn are continuously differentiable functions of X in а 
region S in R”, ¢ is continuously differentiable function of U in a region T of R”, 


(fi(X), fo(X),.... MAET, Xes, 
ФОСЛ (X). fo(X)..... (х) = 0. XES, 


апа 
Š g, (00) >0, Uer. 
je Н 
Show that 
0i. fa... Ja) = 


=0, Хє 5. 
0(х1,х2,..., Xn) 


CHAPTER 7 


Integrals of Functions 
of Several Variables 


IN THIS CHAPTER we study the integral calculus of real-valued functions of several 
variables. 


SECTION 7.1 defines multiple integrals, first over rectangular parallelepipeds in R” and 
then over more general sets. The discussion deals with the multiple integral of a function 
whose discontinuities form a set of Jordan content zero, over a set whose boundary has 
Jordan content zero. 


SECTION 7.2 deals with evaluation of multiple integrals by means of iterated integrals. 


SECTION 7.3 begins with the definition of Jordan measurability, followed by a derivation 
of the rule for change of content under a linear transformation, an intuitive formulation of 
the rule for change of variables in multiple integrals, and finally a careful statement and 
proof of the rule. This is a complicated proof. 


7.1 DEFINITION AND EXISTENCE OF THE MULTIPLE IN- 
TEGRAL 


We now consider the Riemann integral of a real-valued function f defined on a subset of 
R”, where n > 2. Much of this development will be analogous to the development in 
Sections 3.1—3 for n = 1, but there is an important difference: for n = 1, we considered 
integrals over closed intervals only, but for n > 1 we must consider more complicated 
regions of integration. To defer complications due to geometry, we first consider integrals 
over rectangles in R”, which we now define. 


Integrals over Rectangles 


The 
5] X $5 x x Sy 
of subsets S1, S2, ..., Sn of R is the set of points (х, xo, ..., Xn) in IR" such that xı € 
$1, X2 € $5,..., X, € Sn. For example, the Cartesian product of the two closed intervals 
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[a1, bi] x [az, b2] = {(x, у) |а < x < bı, a2 < y < b2} 


is a rectangle in R? with sides parallel to the x- and y-axes (Figure 7.1.1). 


» x 


a 
S ELI 


Figure 7.1.1 
The Cartesian product of three closed intervals 
[a1, bi] x [a2, b2] x [a3 b3] = (Gy. 2) |а < x < bı, а < y < b2, аз < z < b3} 


is a rectangular parallelepiped in R? with faces parallel to the coordinate axes (Figure 7.1.2). 


7 
< 


Figure 7.1.2 
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Definition 7.1.1 A coordinate rectangle R in IR" is the Cartesian product of n closed 
intervals; that is, 
R = [ai, by] x [a2, b2] x - ++ x [an Dy]. 


The content of R is 


V(R) = (bı — 41) (b2 — a2): -- (bn — an). 


The numbers bı — a1, b2 — a2, ..., bn — an are the edge lengths of R. If they are equal, 
then R is a coordinate cube. If a, = b, for some r, then V(R) = 0 and we say that R is 
degenerate; otherwise, R is nondegenerate. ш 


If n = 1, 2, or 3, then V(R) is, respectively, the length of an interval, the area of a 
rectangle, or the volume of a rectangular parallelepiped. Henceforth, “rectangle” or cube" 
will always mean "coordinate rectangle" or "coordinate cube" unless it is stated otherwise. 

If 

R = [a1, 51] x [a2, b2] x --- x [an, bn] 
and 
P,: dp = aro < ari X c X Arm, = br 
is a partition of [a+, br], 1 < r < n, then the set of all rectangles in IR" that can be written 
as 


[a1,/,-1. dj] X [d2,j.-1, 42j2] X х [an 7i dn] LS jr Eme 1<т<п, 


is a partition of R. We denote this partition by 


P = Рх Pax- x Р, (7.1.1) 
and define its norm to be the maximum of the norms of Р}, Р», ..., Pn, as defined in 
Section 3.1; thus, 

| P || = max{|| Pill. || Pall. - I Pall- 


Put another way, || P || is the largest of the edge lengths of all the subrectangles in Р. 


Geometrically, a rectangle in R? is partitioned by drawing horizontal and vertical lines 
through it (Figure 7.1.3); in R?, by drawing planes through it parallel to the coordinate axes. 
Partitioning divides a rectangle R into finitely many subrectangles that we can number in 
arbitrary order as R1, R2, ..., Ry. Sometimes it is convenient to write 


P = {R;, Ro,..., Re} 


rather than (7.1.1). 
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Figure 7.1.3 


If P = P, x P2 x: x P, and P' = Pi x Pj x--- x P, are partitions of the same 
rectangle, then P’ is a refinement of P if Р; isa refinement of Pj, 1 < i < n, as defined in 
Section 3.1. 


Suppose that f is a real-valued function defined on a rectangle Rin R”, P = (Ri, Ro,..., Rg} 
is a partition of R, and X; is an arbitrary point in R;, 1 < j < k. Then 


k 
o = M f(X)V(R;) 


J=1 
is a Riemann sum of f over Р. Since Xj can be chosen arbitrarily in R ;, there are infinitely 
many Riemann sums for a given function f over any partition P of R. 


The following definition is similar to Definition 3.1.1. 


Definition 7.1.2 Let f be a real-valued function defined on a rectangle R in IR". We 
say that f is Riemann integrable on R if there is a number L with the following property: 
For every є > 0, there is a ô > 0 such that 


lo- L| «e 


if o is any Riemann sum of f over a partition P of R such that | P || < 8. In this case, we 
say that L is the Riemann integral of f over R, and write 


/ f(X)dX =L. ш 
R 


If R is degenerate, then Definition 7.1.2 implies that fg f(X) dX = 0 for any function f 
defined on R (Exercise 7.1.1). Therefore, it should be understood henceforth that whenever 
we speak of a rectangle in R” we mean a nondegenerate rectangle, unless it is stated to the 
contrary. 
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The integral fg f(X)dX is also written as 


f tæni») (n =2), f four.ddey.9 (n = 3), 
R R 


or 
f f Q1, X2,..., Xn) d(X1, X2,..., Xn) (n arbitrary). 
R 


Here dX does not stand for the differential of X, as defined in Section 6.2. It merely 
identifies x1, X2,..., Хп, the components of X, as the variables of integration. To avoid this 
minor inconsistency, some authors write simply fg f rather than fg f(X) dX. 


As in the case where n = 1, we will say simply “integrable” or "integral" when we 
mean "Riemann integrable" or "Riemann integral" If 1 — 2, we call the integral of Defi- 
nition 7.1.2 a multiple integral; for n — 2 and n — 3 we also call them double and triple 
integrals, respectively. When we wish to distinguish between multiple integrals and the 
integral we studied in Chapter (n — 1), we will call the latter an ordinary integral. 


Example 7.1.1 Find / f(x, у) d(x, y), where 
R = [a,b] x [c. d] 


and 
fG, y) = x + y. 


Solution Let Р, and Р» be partitions of [a, b] and [c, 4]; thus, 
Pyi:a—xo«xpQ«--«x,—b and Р:с= уо< у <: < у; = а. 


A typical Riemann sum of f over Р = Ру х Р» is given by 


r S 
o — УУ + т) – xi); — Уу-а), (7.1.2) 
i=1 j=1 
where 
xiij € ij € xj and yj-i € mij € yj. (7.1.3) 
The midpoints of [xj 1, x;] and [y;-1, уу] are 
A Xi + Xi— = jd yj- 
X; = A and F; = H, (7.1.4) 
and (7.1.3) implies that 
—, Xi Xi ПРЫ ПРІ 
ы шш ка кш (7.1.5) 
апа 
zs 7у)у—Уу-1 ell Р 
ЕУ —8 2 7» (7.1.6) 
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Now we rewrite (7.1.2) as 


o — Gi +7) х) — yj2 


i21 j=1 


+), > [Ey ^x) + (m; -» )] Gi ^ xi-06; — yj). 
i=1j=1 
To find fg f(x, у) d(x, y) from (7.1.7), we recall that 
У -x-)-2b-a Уу-уу) =d-c (7.1.8) 
і=1 j=l 
(Example 3.1.1), and 
30 — x74) = 2 –а?, 3:05 - x9 = 42 – с? (7.1.9) 
і=1 j=l 


(Example 3.1.2). 


(7.1.7) 


Because of (7.1.5) and (7.1.6) the absolute value of the second sum in (7.1.7) does not 


exceed 


IPI D>) 56s - 4-10, - »;-0 = IP | [Ee =) $ Oj- yj) 
j=l 


ј=1 ј=1 і=1 
= ||P — ay – с) 
(see (7.1.8)), so (7.1.7) implies that 


o-9 > 06: —xi-)6; — уу-а)| S IPIE а – с). (1.10) 
і=1 ј=1 
It now follows that 


УУ, Xii = xi-1)(yj = Yj-1) = [хе =) УО, = у]-1) 
j=1j=1 iei je 


= (d —c)9 XiGx; — х-л) (from (7.1.8) 


i=l 

= : T уо — х? 1) (from (7.1.4)) 
i=1 

= d z (b? _ a?) (from (7.19). 


Similarly, 
r s Е C 
25 DiGi = xi-1)(¥j — yj-)) = —;(@4° — с?). 


i=1 j=1 
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Therefore, (7.1.10) can be written as 


o — Sa? ап) 40е ол) рр) — o. 


Since the right side can be made as small as we wish by choosing || P || sufficiently small, 


[+ vate») = 5 [d - 00? а) + 6 аа? - e). 


Upper and Lower Integrals 


The following theorem is analogous to Theorem 3.1.2. 


Theorem 7.1.3 If f is unbounded on the nondegenerate rectangle R in R”, then f is 
not integrable on R. 


Proof We will show that if f is unbounded on R, P = (R4, Ro,..., Rx} is any parti- 
tion of R, and М > 0, then there are Riemann sums с and o’ of f over P such that 


lc — o'| > M. (7.1.11) 

This implies that f cannot satisfy Definition 7.1.2. (Why?) 
Let 
k 
o =) f(X;)V(R;) 

Ј=1 

be a Riemann sum of f over P. There must be an integer i іп {1,2,...,k} such that 
|f(X) — /(%;)| > - (7.1.12) 
© T V(Ri) B 


for some X in R;, because if this were not so, we would have 


M 
IPC) - FR)! < усу: Xe Rj, 1€] 


If this is so, then 
СХ) = | f(Xj) + IX- СХ) S |/(Х,)| + 1/09 — f(X5) 


M 
<|f&%)| + =. XeR;, 1sj xk. 
J V(R;) J. 


However, this implies that 


|f (X)| < max SAD + уу 56 ‚ XER, 


which contradicts the assumption that f is unbounded on R. 
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Now suppose that X satisfies (7.1.12), and consider the Riemann sum 
n 
o = 3 f(X)V() 
j=1 
over the same partition Р, where 
xx ini 


Since 
la — о'| =| f(X) – f(Xi)|V(Ri), 
(7.1.12) implies (7.1.11). [| 


Because of Theorem 7.1.3, we need consider only bounded functions in connection with 
Definition 7.1.2. As in the case where n — 1, it is now convenient to define the upper 
and lower integrals of a bounded function over a rectangle. The following definition is 
analogous to Definition 3.1.3. 


Definition 7.1.4 If f is bounded on a rectangle R in R” and P = (Ri, Ro,..., Rx} 
is a partition of R, let 


М; = sup fX), т; = inf fX). 
d XeR; ^ хек, 


The upper sum of f over P is 


k 
S(P) = у  M;V(Rj), 


Ј=1 


and the upper integral of f over R, denoted by 


fJ rœax. 


is the infimum of all upper sums. The lower sum of f over P is 


k 
s(P) = y m; VR) 


j=l 


and the lower integral of f over R, denoted by 
| fevax, 
LR 
is the supremum of all lower sums. E 


The following theorem is analogous to Theorem 3.1.4. 
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Theorem 7.1.5 Let f be bounded on a rectangle R and let P be a partition of R. 
Then 


(a) The upper sum S(P) of f over P is the supremum of the set of all Riemann sums of 
f over P. 


(b) The lower sum s(P) of f over P is the infimum of the set of all Riemann sums of f 
over P. 


Proof Exercise 7.1.5. 


If 
т < f(X) M forXin R, 


then 
mV(R) < s(P) x S(P) x MV(R); 


therefore, Te ГОХ) dX and fg f (X) dX exist, are unique, and satisfy the inequalities 


mV(R) < nns dX < MV(R) 
R 


and 
mV(R) < Í f(X)dX < MV(R). 
DR 


The upper and lower integrals are also written as 


/ Jopie and f fide (22, 
R JR 


[fe ».246.».2 and [ fe ».240..2 (n = 3), 
R JR 


or 


/ f Q1, X2... Xn) d(x1, X2,.--, Xn) 
R 
and 
Í f Q1, X2, ..., Xn) d(xi, X2... Xn) (n arbitrary). 
R 


Example 7.1.2 Find f, f(x, y) d(x, y) and ТБО) а(х, y), with R = [a,b] x 
[c, d] and 

Јо, у) =х+у, 
as in Example 7.1.1. ш 


Solution Let Р, and Р» be partitions of [a, b] and [c, d]; thus, 


Pyi:a—xo«xpQ«--«x,—b and Р:с= уо< у <: «ys = а. 
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The maximum and minimum values of f on the rectangle [xi 1, x;]<[yj;-1, уу] are xj +y; 
and х;—1 + y j-1, respectively. Therefore, 


S(P) = УУ Gu + уу) —xi-06/j — yj) (7.1.13) 
i=1 j=1 
and 
s(P) = у | у Gia + yj) —xi-06; — yj). (7.1.14) 
i=1 ј=1 


By substituting 
1 
Xi yj = xi + ж-а) + OF + Уј) + Gi = xi + (уу — yj 
into (7.1.13), we find that 
1 
S(P) = 5601 + 92 + Уз + X4), (7.1.15) 


where 


Di = 02-320 560;-»;-0 = (02 -ad – с), 
i=1 j=1 


У = У — Xi-1) Уо» — У? 1) = (b — a)(d? — c?), 


i=1 j=l 
Уз = Qu — xa $0; — уу-1) < PIG — а — с), 
i=1 Ј=1 
Xa = $ Œ = xi) У 0 — Yi? s IPIE — а) — с). 
і=1 Ј=1 


Substituting these four results into (7.1.15) shows that 
I«S(P)«I-JP|(b-—a)(d —c), 


where 


_ (d - с)? – a?) + (b – a)(d? — c?) 


I 
2 


From this, we see that 


[^ + y)d(x, y) = I. 
After substituting 
1 
хі-1 + yj-1 = 5169 3-X:-1) + (y + уу-1)— (xi — X) — (Yj — Yyj-1)] 


into (7.1.14), a similar argument shows that 


I- |P|(b—a)(d – с) «s(P) <I, 
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f etie» = 1 н 
We now prove an analog of imm 33.1. 
Lemma 7.1.6 Suppose that | f(X)| < M ifX is in the rectangle 
R = [a1, bı] x [a2, b2] x +++ x [an, bn]. 


Let P = Ру x Рх... x P, and P! = Pj x P5 x---x P, be partitions of R, where Р; 
is obtained by adding г; partition points to Pj, 1 < j < п. Then 


n 


S(P) > S(P) = 5(Р) -24 VQ) | X ; "^ pj (7.1.16) 
j=l 7 
and 
s(P) < s(P') < (Р) + 2MV(R) | $7 7 i) Pl. (7.1.17) 


ј=1 


Proof We will prove (7.1.16) and leave the proof of (7.1.17) to you (Exercise 7.1.7). 
First suppose that Р; is obtained by adding one point to Р, and P; = Р; fr2 < j <n. 
If P, is defined by 


P, : ar = ар < ari < +t < arm, = br, 1<r<n, 
then a typical subrectangle of P is of the form 
Rj jamin = aii aii] X (a2, jo—-1 4252] X +++ X [an,j,—1. anjn]. 
Let c be the additional point introduced into Р! to obtain Р/, and suppose that 
üjk—|] < C € djk. 


If jı Z k, then Rj у. у, is common to P and P’, so the terms associated with it in S(P") 
and S(P) cancel in the difference S(P) — S(P"). To analyze the terms that do not cancel, 
define 


1 

RED, = aes C1 х [22,571,227] X +++ X lan ji -1 Ann) 
2 

ЕЁ) „„ = [es ак] X [2,571 0275] X +++ X [апалап 


Myj,.., = sup(f(X)|X € Кк} (7.1.18) 


and 
MÉ., = sup { f(X)|Xe Boss i=1,2. (7.1.19) 
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Then S(P) — S(P’) is the sum of terms of the form 


Lo (aik — d1,k—1) — MY? (c — a1k—1) — м ‚ (Aik — o) 


kja- jn 27" Jn (7.1.20) 
X(d2j, — 02,j5—1) +++ (anjn — dn, ja -1)- 
The terms within the brackets can be rewritten as 
(Mijn = Mg). s (e а-л) (Misi, — MQ... (ak —с), (7121) 
which is nonnegative, because of (7.1.18) and (7.1.19). Therefore, 
S(P^) < S(P). (7.1.22) 


Moreover, the quantity in (7.1.21) is not greater than 2M (аук —41,k-1), so (7.1.20) implies 
that the general surviving term іп S(P) — S(P’) is not greater than 
2M | P ||(a2;, — a2,j5-1) (ап), — An, jn—1): 
The sum of these terms as jz, ..., jn assume all possible values 1 < j; < mj,2 <i <n, 
is 
2M || P\|V(R) 
2M IP |02 — a2) s — an) = 21210, 
1—41 
This implies that 
2M||P]|V(R) 
bi — 01 : 
This and (7.1.22) imply (7.1.16) for rı = 1 and r2 =--- = rn = 0. 
Similarly, ifr; = 1 for some i in(1,...,nj andr; = Oif j Z i, then 
2M ||P|V(R) 
bi — aj ` 


S(P) < S(P’) + 


S(P) x S(P)- 


To obtain (7.1.16) in the general case, repeat this argument rı + ro +--+: + rn times, as in 
the proof of Lemma 3.2.1. ш 


Lemma 7.1.6 implies the following theorems and lemma, with proofs analogous to the 
proofs of their counterparts in Section 3.2. 


Theorem 7.1.7 If f is bounded on a rectangle R, then 
f ax = f reo ax. 
JR R 


Proof Exercise 7.1.8. 


The next theorem is analogous to Theorem 3.2.3. 


Theorem 7.1.8 If f is integrable on a rectangle R, then 
Í f(X)dX = | f(X)dX = | f(X) dX. 
JR R R 


Proof Exercise 7.1.9. 
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Lemma 7.1.9 If f is bounded on a rectangle R and € > 0, there is a > 0 such that 


f(X) dX < S(P) <f fX)dX +e 
R 


x 


R 

and 
f /®ах =з) > | f@ax-e 
JR JR 

if | P|| < ô. 


Proof Exercise 7.1.10. 


The next theorem is analogous to Theorem 3.2.5. 


Theorem 7.1.10 Г f is bounded on a rectangle R and 


[ (oux - J rœax =F, 


then f is integrable on R, and 


[годах =L. 


Proof Exercise 7.1.11. 


Theorems 7.1.8 and 7.1.10 imply the following theorem, which is analogous to Theo- 
rem 3.2.6. 


Theorem 7.1.11 A bounded function f is integrable on a rectangle R if and only if 
| Г) ах = | F(X) ах. 
JR R 


The next theorem translates this into a test that can be conveniently applied. It is analo- 
gous to Theorem 3.2.7. 


Theorem 7.1.12 If f is bounded on a rectangle R, then f is integrable on R if and 
only if for every є > 0 there is a partition P of R such that 


S(P) —s(P) « e. 


Proof Exercise 7.1.12. 


Theorem 7.1.12 provides a useful criterion for integrability. The next theorem is an 
important application. It is analogous to Theorem 3.2.8. 


Theorem 7.1.13 If f is continuous оп а rectangle R in R”, then f is integrable on R. 


448 Chapter 7 Integrals of Functions of Several Variables 


Proof Lete > 0. Since f is uniformly continuous on R (Theorem 5.2.14), there is a 
б > 0 such that А 

X) - f(X)| < —~ 7.1.23 

О) FRI < Foe (7.1.23) 


if X and X’ are in R and |X — X'| < 6. Let P = (R4, Ro, ..., Ёк} be a partition of R with 
| P || < 6/./n. Since f is continuous оп R, there are points X; and X, in R; such that 


f(X;)— Mj = sup fX) and (Ху) = m; = inf fX) 
XeRj XeR; 


(Theorem 5.2.12). Therefore, 


S(P) - (P) = У(Х) — f/(X,)V(8). 


j=1 


Since ||P || < 6/./n, |X; — Х| < 8, and, from (7.1.23) with X = X; and X' = X', 


k 
€ 
S(P) — s (P) < —— V(Rj) = є. 
V(R) 2. i 
Hence, f is integrable on R, by Theorem 7.1.12. 


Sets with Zero Content 


The next definition will enable us to establish the existence of f r J (X) dX in cases where 
f is bounded on the rectangle R, but is not necessarily continuous for all X in R. 


Definition 7.1.14 A subset E of R" has zero content if for each € > 0 there is a finite 
set of rectangles T1, T5, ..., Tm such that 


m 
ЕС\)Т; (7.1.24) 
j=l 
and 
m 
XO V(T;) <e. (7.1.25) 
j=1 


Example 7.1.3 Since the empty set is contained in every rectangle, the empty set has 
zero content. If E consists of finitely many points X1, X2, ..., Xm, then X; can be enclosed 
in a rectangle T; such that 


VT) <<, 1<j<m. 
m 


Then (7.1.24) and (7.1.25) hold, so Е has zero content. 


Section 7.1 Definition and Existence of the Multiple Integral 449 


Example 7.1.4 Any bounded set E with only finitely many limit points has zero con- 
tent. To see this, we first observe that if E has no limit points, then it must be finite, by the 
Bolzano-Weierstrass theorem (Theorem 1.3.8), and therefore must have zero content, by 
Example 7.1.3. Now suppose that the limit points of E are X4, X2, ..., Xm. Let Ri, Ro, 
..., Rm be rectangles such that X; € R? and 


V(Ri)<—, 1<i<m. (1.1.26) 
2m 


m 


The set of points of E that аге not in U}; Ку has no limit points (why?) and, being 
bounded, must be finite (again by the Bolzano—Weierstrass theorem). If this set contains p 
points, then it can be covered by rectangles R}, R5, ..., К, with 


V(R;)« A 1<j<p. (7.1.27) 


Now, 


and, from (7.1.26) and (7.1.27), 
m p 
Уик) + DO VR) « e. 
i=1 j=l 
Example 7.1.5 If f is continuous on [a, b], then the curve 
у= f(x), asx<b (7.1.28) 


(that is, the set {(x, y) | y= f(x), ахх < b}), has zero content in R?. To see this, 
suppose that є > 0, and choose 6 > 0 such that 


lf) - f(x)| «e if x,x'e[a,b] and |x— x'| <6. (7.1.29) 
This is possible because f is uniformly continuous on [a, b] (Theorem 2.2.12). Let 
Р:а= хо< х < < хр =b 
be a partition of [a, b] with || P || < 6, and choose ё1, £2, ..., En so that 
Xi Lé Exi lxitzn. 
Then, from (7.1.29), 
|50) FED «e if xiz <x < xi. 


This means that every point on the curve (7.1.28) above the interval [x;—1, x;] is in a rect- 
angle with area 2e(x; — xi—1) (Figure 7.1.4). Since the total area of these rectangles 15 
2e(b — a), the curve has zero content. 
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y 


i =~ IM MMMM y=f(§,) +e 


Figure 7.1.4 


The next lemma follows immediately from Definition 7.1.14. 
Lemma 7.1.15 The union of finitely many sets with zero content has zero content. 


The following theorem will enable us to define multiple integrals over more general 
subsets of R”. 


Theorem 7.1.16 Suppose that f is bounded on a rectangle 
R= [@1, b1] x [a2, b2] x -++ x [an, bn] (7.1.30) 


and continuous except on a subset E of R with zero content. Then f is integrable on R. 


Proof Suppose that є > 0. Since E has zero content, there are rectangles T1, T5, ..., 
Tm such that 


m 
Ве) (7.1.31) 
j=1 
and 
m 
У`И(Т;) <є. (7.1.32) 
ј=1 
We may assume that T1, T5, ..., Tm are contained in А, since, if not, their intersections 


with R would be contained in R, and still satisfy (7.1.31) and (7.1.32). We may also assume 
that if T is any rectangle such that 


m 
ШЕ La? =ø, thn TNE=90 (7.1.33) 
j=l 
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since if this were not so, we could make it so by enlarging Ту, 75, ..., Tm slightly while 
maintaining (7.1.32). Now suppose that 


T; = [aij bij] x [a2;, b2;] x +++ x [anj,bnj], LS ji <m, 
let Р;о be the partition of [a;, bi] (see (7.1.30)) with partition points 
di , bi. aii bi1, ар, Dia... dim, Dim 
(these are not in increasing order), 1 <i < n, and let 
Po = Pio X P590 X *-- X Pro. 


Then Ро consists of rectangles whose union equals От Т; and other rectangles Тү, Т», 
..., Тү that do not intersect Е. (We need (7.1.33) to be sure that 77 N E = 0,1 <i < k.) 


If we let 
m k 
Be Ere aa С=|\)Т;, 
Zi 


i=1 


then R = B UC and f is continuous on the compact set C. If P = (Ri, R2,..., Rg} is 
a refinement of Po, then every subrectangle R; of P is contained entirely in B or entirely 
in C. Therefore, we can write 


S(P) —s(P) = X1(M; —m;)V(R;) + X2(M; —m;)V(R;), (7.1.34) 


where У; and X> are summations over values of j for which R; C B and К; C C, 
respectively. Now suppose that 


|f(X)| x М forXin А. 


Then 


m 
Xi(M; —m;)V(Rj) < 2M XAV(R;) = 2M V (Ту) < 2Me, (7.1.35) 
j=1 


from (7.1.32). Since f is uniformly continuous on the compact set C (Theorem 5.2.14), 
there is a ô > 0 such that M; — m; < € if ||P || <6 and R; C C; hence, 


Xo(M;j = mj;)V(Rj) <é? V(R;) <eV(R). 
This, (7.1.34), and (7.1.35) imply that 
S(P) —s(P) < DM + V(R)]e 


if ||P || < ô and P is a refinement of Po. Therefore, Theorem 7.1.12 implies that f is 
integrable on R. ш 
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Example 7.1.6 The function 
x+y, O<x<y<l, 
f@y)= 
5, O<y<x<l, 
is continuous on R = [0, 1] x [0, 1] except on the line segment 


y=x, Ox<x<l 


(Figure 7.1.5). Since the line segment has zero content (Example 7.1.5), f is integrable on 
R. 


До, у) =х+у 


Figure 7.1.5 


Integrals over More General Subsets of R" 


We can now define the integral of a bounded function over more general subsets of R”. 


Definition 7.1.17 Suppose that f is bounded on a bounded subset of S of R”, and let 
fX), Xes, 


X) = 
fs (X) " X45. 


(7.1.36) 


Let R be a rectangle containing S. Then the integral of f over S is defined to be 
[годах = f з@уах 
S R 


if fk fs X) dX exists. ш 
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To see that this definition makes sense, we must show that if А; and К» are two rect- 
angles containing S and Sr, fs(X) dX exists, then so does In; fs(X) dX, and the two 
integrals are equal. The proof of this is sketched in Exercise 7.1.27. 


Definition 7.1.18 If S is a bounded subset of R” and the integral fẹ dX (with inte- 
grand f = 1) exists, we call ts d X the content (also, area if n = 2 or volume if n = 3) 
of S, and denote it by V(S); thus, 


vis) = | dX. 


Theorem 7.1.19 Suppose that f is bounded on a bounded set S and continuous ex- 
cept on a subset E of S with zero content. Suppose also that 0S has zero content. Then f 
is integrable on S. 


Proof Let fs be as in (7.1.36). Since a discontinuity of fs is either a discontinuity of f 
or a point of д5, the set of discontinuities of fs is the union of two sets of zero content and 
therefore is of zero content (Lemma 7.1.15). Therefore, fs is integrable on any rectangle 
containing S (from Theorem 7.1.16), and consequently on S (Definition 7.1.17). п 


Differentiable Surfaces 


Differentiable surfaces, defined as follows, form an important class of sets of zero content 
in IR", 


Definition 7.1.20 A differentiable surface S in R" (n > 1) is the image of a compact 
subset D of IR", where m < n, under a continuously differentiable transformation G : 
R” — К”. If m = 1, S is also called a differentiable curve. 


Example 7.1.7 Thecircle 


{(x.y) |x? +? = 9} 


is a differentiable curve in R?, since it is the image of D = [0, 27] under the continuously 
differentiable transformation G : IR — R? defined by 


x= вв = [3 ]. 
Example 7.1.8 The sphere 
{(x, y z) |x? + y? +27 =4} 
is a differentiable surface in R?, since it is the image of 
D = {(0,ġ) |0 < 0 < 2л,-л/2< ф < 7/2} 
under the continuously differentiable transformation G : IR? — R? defined by 
2 cos Ө cos o 


X = С(0,ф) = | 2sin0cosó 
2sing 
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Example 7.1.9 The set 
{(x1, хо, хз, ха) | xi > 0 (7 = 1,2,3, 4), xı + x2 = 1, хз + X4 = 1} 


is a differentiable surface in IR^, since it is the image of D = [0, 1] x [0, 1] under the 
continuously differentiable transformation G : IR? — R^ defined by 


и 


X = Glu, v) = 


Theorem 7.1.21 A differentiable surface in R” has zero content. 


Proof Let S, D, and G be as in Definition 7.1.20. From Lemma 6.2.7, there is a 
constant M such that 


|G(X) — G(Y)| < MIX-Y| if X,YeD. (7.1.37) 
Since D is bounded, D is contained in a cube 
C = [a1, bı] x [a2. b2] XX lam, bm], 


where 
bj—aj—-L, 1<i<m. 


Suppose that we partition C into №” smaller cubes by partitioning each of the intervals 
lai, bj] into N equal subintervals. Let Ау, R2, ..., Ry be the smaller cubes so produced that 
contain points of D, and select points X1, X2, ..., Xy such that X; € DN Rj, 1 <i < К. 
If Y € D Ri, then (7.1.37) implies that 

IG(X;) — G(Y)| x M|X; — Y|. (7.1.38) 
Since X; and Y are both in the cube R; with edge length L/ №, 


La 
|X; - Y| < cM 
N 


This and (7.1.38) imply that 


IGX;) - GY) < MN 


which in turn implies that G(Y) lies in a cube fi in IR" centered at G(X;), with sides of 
length 2M L /m/ №. Now 


k n n 
~ 2ML4 2MLA/ 
Y v) =k (T) у" (|) = oML/my м". 
i=1 N N 
Since n > m, we can make the sum on the left arbitrarily small by taking N sufficiently 


large. Therefore, S has zero content. ш 


Theorems 7.1.19 and 7.1.21 imply the following theorem. 
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Theorem 7.1.22 Suppose that S is a bounded set in R” , with boundary consisting of 
a finite number of differentiable surfaces. Let f be bounded on S and continuous except 
on a set of zero content. Then f is integrable on S. 


Example 7.1.10 Let 
S = {œ y) |x? +y =1, x 20}; 


thus, S is bounded by a semicircle and a line segment (Figure 7.1.6), both differentiable 
curves in 2. Let 


ишш л 
х,у)= 

—(1—х2—)у?)!/?, 3X 55$ у <0. 
Then f is continous on S except on the line segment 


y=0, 0<х=<1, 


which has zero content, from Example 7.1.5. Hence, Theorem 7.1.22 implies that f is 
integrable on S. 


х+у2=1, x20 


>x 


Figure 7.1.6 


Properties of Multiple Integrals 


We now list some theorems on properties of multiple integrals. The proofs are similar to 
those of the analogous theorems in Section 3.3. 

Note: Because of Definition 7.1.17, if we say that a function f is integrable on a set S, 
then S is necessarily bounded. 
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Theorem 7.1.23 If f and g are integrable on S, then so is f + g, and 
| * 9004x = | roo ax | кодах, 


Proof Exercise 7.1.20. 


Theorem 7.1.24 If f is integrable on S and c is a constant, then cf is integrable on 
S, and 


| «oo ах = ef fO) ах. 
Proof Exercise 7.1.21. 
Theorem 7.1.25 If f and g are integrable on S and f(X) < g(X) for X in S, then 
[ /®ах = | ходах. 


Proof Exercise 7.1.22. 


Theorem 7.1.26 If f is integrable on S, then so is | f |, and 


| | f(X) dX 


< Í; |/ GO] dX. 


Proof Exercise 7.1.23. 
Theorem 7.1.27 If f and g are integrable on S, then so is the product fg. 
Proof Exercise 7.1.24. 


Theorem 7.1.28 Suppose that и is continuous and v is integrable and nonnegative on 
a rectangle R. Then 


/ u(X)v(X)dX = iX» | v(X)dX 
R R 

for some Xo in R. 

Proof Exercise 7.1.25. 


Lemma 7.1.29 Suppose that S is contained in a bounded set T and f is integrable 
on S. Then fs (see (7.1.36)) is integrable on T, and 


| fs(X) dX = [ f(X) dX. 


Proof From Definition 7.1.17 with f and S replaced by fs and T, 
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Crs an a or 


Since S C T, (fs)r = fs. (Verify.) Now suppose that R is a rectangle containing Т. 
Then R also contains S (Figure 7.1.7), 


Figure 7.1.7 


so 
Í f(X)aX = |. fs(X)dX (Definition 7.1.17, applied to f and S) 
S R 
= IU: (since (fs)r — fs) 
= f fs(X)dX (Definition 7.1.17, applied to fs and T), 
T 
which completes the proof. E 


Theorem 7.1.30 If f is integrable on disjoint sets Sı and S2, then f is integrable on 
$4 U S5, and 


Í f(%)dX = Í fX)dX + T f(x) dx. (7.1.39) 
510852 $1 S2 
Proof Fori = 1, 2, let 
fX), Xe Si, 
fs; (X) " X45. 


From Lemma 7.1.29 with S = S; and T = 51 U S», fs, is integrable on S1 U $5, and 


f fs,xyax = | fX)dX, i21,2. 
51052 Si 


Theorem 7.1.23 now implies that fs, + fs, is integrable on Sı U S2 and 


Í (fs, + fs,)(K) dX = Í f(X)dX + Í РОХ) aX. (7.1.40) 
51082 $1 $5 
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Since Sı N S5 = Ø, 


(fs, + fs.) X) = fs, (X) + fs,QO = fX), Xes US. 


Therefore, (7.1.40) implies (7.1.39). E 
We leave it to you to prove the following extension of Theorem 7.1.30. (Exercise 7.1.31(b)). 


Corollary 7.1.31 Suppose that f is integrable on sets Sq and S5 such that Sı N S5 
has zero content. Then f is integrable on Sq U S2, and 


ls /®ах= f годах f f(X) dX. 


Example 7.1.11 Let 


Si={@,y)|0<x<1,0<y<1+x} 
and 
52 = {(х, у) | -l<x<0,0<y<1-x} 


(Figure 7.1.8). 


Figure 7.1.8 


Then 
SiNS.={@,y)|O<y x 1) 


has zero content. Hence, Corollary 7.1.31 implies that if f is integrable on 5; and 52, then 
f is also integrable over 


5 = 5105 = {(х,у) | -1<х<1,0<у<1+ |х|} 


(Figure 7.1.9), апа 


[ug Fax | fooax « | годах 
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У y 


y=l+x 


Figure 7.1.9 


We will discuss this example further in the next section. 


7.1 Exercises 


Prove: If R is degenerate, then Definition 7.1.2 implies that fk f(X)dX = Oif f 
is bounded on R. 


Evaluate directly from Definition 7.1.2. 
(a) fp@x+2y)d(x,y); R= [0,2] x [1,3] 
(b) /pxyd(x,y); R= [0,1] х [0,1] 


Suppose that /? f (x) dx and p g(y) dy exist, and let А = [a, b] x [c, d]. Criticize 
the following “proof” that fg f (x)g(y) d(x, y) exists and equals 


(ЖО (ow). 


(See Exercise 7.1.30 for a correct proof of this assertion.) 
“Proof.” Let 


Pyi:a—xo«xp <- <x, =b and Pp:c=yo< у <: < у; =d 


be partitions of [a, b] and [c, d], and P = P4 x P2. Then a typical Riemann sum of 
fg over P is of the form 


c= У, у) Рб) (п) — xiz); — Yj-1) = 0102, 
і=1 j=l 


where 


o=) SED xi) and o= У (п); yj) 


i=l j=l 
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15. 


are typical Riemann sums of f over [a,b] and g over [c,d]. Since f and g are 
integrable on these intervals, 


b d 
a-f f(x)dx| and o- | g(y) dy 


can be made arbitrarily small by taking || P1|| and || P2|| sufficiently small. From 
this, itis straightforward to show that 


(fre (f me) 


can be made arbitrarily small by taking ||P || sufficiently small. This implies the 
stated result. 


Suppose that f(x,y) > 0 on R = [a,b] x [c,d]. Justify the interpretation of 
Jr fx. y) d(x, y), if it exists, as the volume of the region in IR? bounded by the 
surfaces z = f(x, у) апа the planes z = 0, x = a, х = b, y —c,and y = d. 


Prove Theorem 7.1.5. HINT: See the proof of Theorem 3.1.4. 


Suppose that 
0 if x and y are rational, 
Fie 1 if x is rational and y is irrational, 
Xy) = 2 if x is irrational and y is rational, 
3 if x and y are irrational. 
Find 


J FEDE) ana [fe a0» it К = [a,b] x [c. d]. 
R JR 


Prove Eqn. (7.1.17) of Lemma 7.1.6. 

Prove Theorem 7.1.7 HINT: See the proof of Theorem 3.2.2. 

Prove Theorem 7.1.8 HINT: See the proof of Theorem 3.2.3. 

Prove Lemma 7.1.9 HINT: See the proof of Lemma 3.2.4. 

Prove Theorem 7.1.10 HINT: See the proof of Theorem 3.2.5. 

Prove Theorem 7.1.12 HINT: See the proof of Theorem 3.2.7. 

Give an example of a denumerable set in R? that does not have zero content. 
Prove: 


(a) If S, and S2 have zero content, then S4 U S» has zero content. 
(b) If S, has zero content and S5 C S1, then S» has zero content. 
(c) If S has zero content, then S has zero content. 


Show that a degenerate rectangle has zero content. 


16. 


17. 


18. 


19. 


20. 
21. 
22. 
23. 
24. 
25. 
26. 


27. 


28. 
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Suppose that f is continuous on a compact set S in R”. Show that the surface 
z = f(X), X € S, has zero content in R^*!. HINT: See Example 7.1.5. 


Let S be a bounded set such that S (1 0S does not have zero content. 


(a) Suppose that f is defined on S and f(X) > p > 0 on a subset T of SN 3S 
that does not have zero content. Show that f is not integrable on S. 


(b) Conclude that V(S) is undefined. 


(a) Suppose that h is bounded and A(X) = 0 except on a set of zero content. 
Show that fọ h(X) dX = 0 for any bounded set S. 


(b) Suppose that fẹ f (X) dX exists, g is bounded on S, and f(X) = g(X) except 
for X in a set of zero content. Show that g is integrable on S and 


| є(Х)ах = [ F(X) ax. 


Suppose that f is integrable on a set S and 50 is a subset of S such that 0So has 
zero content. Show that f is integrable on So. 


Prove Theorem 7.1.23 HINT: See the proof of Theorem 3.3.1. 
Prove Theorem 7.1.24. 
Prove Theorem 7.1.25 HINT: See the proof of Theorem 3.3.4. 
Prove Theorem 7.1.26 HINT: See the proof of Theorem 3.3.5. 
Prove Theorem 7.1.27 HINT: See the proof of Theorem 3.3.6. 
Prove Theorem 7.1.28 HINT: See the proof of Theorem 3.3.7. 


Prove: If f is integrable on a rectangle R, then f is integrable on any subrectangle 
of R. HINT: Use Theorem 7.1.12; see the proof of Theorem 3.3.8. 


Suppose that R and R are rectangles, R C R, g is bounded on R, and g(X) = Oif 
X4 R. 


(a) Show that fx g(X) dX exists if and only if fp g(X) dX exists and, in this 


case, 
кодах = f g(X) dX. 
R R 


HINT: Use Exercise 7.1.26. 

(b) Use (a) to show that Definition 7.1.17 is legitimate; that is, the existence and 
value of f s JX) dX does not depend on the particular rectangle chosen to 
contain S. 


(a) Suppose that f is integrable on a rectangle R and Р = (Ri, Ro,..., Rx} is 
a partition of R. Show that 


k 
годах = 2 ОХ) dX. 


HINT: Use Exercise 7.1.26. 
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(b) Use (a) to show that if f is continuous on R and P is a partition of R, then 
there is a Riemann sum of f over P that equals fg f(X) dX. 


29. Suppose that f is continuously differentiable on a rectangle R. Show that there is a 
constant M such that 


x М|Р| 


с — | f(X)dX 
R 
ifo is any Riemann sum of f over a partition P of R. HINT: Use Exercise 7.1.28(b) 
and Theorem 5.4.5. 
30. Suppose that /? f (x) dx and ie g(y) dy exist, and let R = [а, р] x [c, d]. 
(a) Use Theorems 3.2.7 and 7.1.12 to show that 


I Духу) and Í ey) d(x, y) 
R R 


both exist. 
b) Use Theorem 7.1.27 to prove that x d(x, y) exists. 
р R SUY y 
(c) Justify using the argument given in Exercise 7.1.3 to show that 


b d 
| /бдв(у)4й(х, у) = | | поа) | Í «o. 


31. (a) Suppose that f is integrable on S and So is obtained by removing a set of 
zero content from S. Show that f is integrable on So and f. So f(X)dX = 


fs F(X) dx. 
(b) Prove Corollary 7.1.31. 


7.2 ITERATED INTEGRALS AND MULTIPLE INTEGRALS 


Except for very simple examples, it is impractical to evaluate multiple integrals directly 
from Definitions 7.1.2 and 7.1.17. Fortunately, this can usually be accomplished by evalu- 
ating n successive ordinary integrals. To motivate the method, let us first assume that f is 
continuous on R = [a,b] x [c,d]. Then, for each y in [c,d], f(x, y) is continuous with 
respect to x on [a, b], so the integral 


b 
F(y) = f f(x, dx 


exists. Moreover, the uniform continuity of f on R implies that F is continuous (Exer- 
cise 7.2.3) and therefore integrable on [c, 4]. We say that 


h -f F(y) dy -f ([ ree) dy 
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is an iterated integral of f over R. We will usually write it as 


n= f a f sonar 


Another iterated integral can be defined by writing 


d 
со) = f fe,ydy, a<x<b, 


b b d 
һ= | со) = | (/ fanas) dx, 
which we usually write as 
b d 
в= | dx | foa. 


f(x, y)H=x+y 


and defining 


Example 7.2.1 Let 
and R = [0, 1] x [1,2]. Then 


1 1 2 
ro) f лода | ends = (S) 


and 
2 2/1] y y? 2 
h = F(y)dy = = dy = | = + — L2. 
1 / (у) dy f Gr) (242), 
Also, 
2 y? 2 1 3 
a= f «+» = (97) =@х+®-(х+») =х+5, 
1 2 у=1 2 2 


апа 
: ! 3 x? Зх 
в= | содае | (+3) а= (6+9) 


In this example, / = J; moreover, on setting a = 0, b = 1, с = 1, and d = 2 іп 
Example 7.1.1, we see that 


Je *»46.» 22. 
R 


so the common value of the iterated integrals equals the multiple integral. The following 
theorem shows that this is not an accident. 
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Theorem 7.2.1 Suppose that f is integrable on R = |а, Б] x [c, d] and 


b 
F() = [| fe, dx 


exists for each y in |c, d]. Then F is integrable on |c, d], and 


d 
Í FO) dy = | /(х, y) d(x, у); (7.2.1) 
that is, 


d b 
f ay f fe. dx= | fæ у), у). (1.2.2) 


Proof Let 
Ру:а= хо<х <: < х, =b and Р:с= уо< у <: < у; = а 


be partitions of [a, b] and [с, d], and = Р; x P2. Suppose that 


Jua Sj sys 1<]<5, (7.2.3) 
SO 
s 
o = У`Е()0 = yj-1) (7.2.4) 
Ј=1 


is a typical Riemann sum of F over P5. Since 
b д x 
ға) = | летах У | летах, 
а ї=1“ 1—1 

(7.2.3) implies that if 

mij = inf { f (x, y) | Xi—1 S X € Xi, уу-у < yj] 

and 

Mi; = sup { f(x, y) |а < x < ургу 03). 

then 


r r 
у mij (xi —xi-1) € F(nj) € Уу Mi (xi = Xj-1). 
i=1 i=1 


Multiplying this by y; — уу— and summing from j = 1 to j = s yields 


у, у mi (xi = xiij — yj) < 2 F(nj)(y; = yj-0) 


j=li=1 j=l 


S r. 
s: Mi (i — 1-1); — Уу-1), 
J 


j=1i=1 
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which, from (7.2.4), can be rewritten as 
sr(P) xo x Sy(P), (7.2.5) 


where 5 (Р) and S (Р) are the lower and upper sums of f over P. Now let sp (P2) and 
S r (P5) be the lower and upper sums of F over P»; since they are respectively the infimum 
and supremum of the Riemann sums of F over Р» (Theorem 3.1.4), (7.2.5) implies that 


ss (P) S sr (P2) < Sr (P2) < 5 (Р). (7.2.6) 


Since f is integrable on R, there is for each є > 0 a partition P of R such that S , (P) — 
s¢(P) < e, from Theorem 7.1.12. Consequently, from (7.2.6), there is a partition Р» of 
[с, d] such that Sp (P5) — sr(P2) < є, so F is integrable on [c, d], from Theorem 3.2.7. 


It remains to verify (7.2.1). From (7.2.4) and the definition of f 4 Е (у) dy, there is for 
each e > 0a ô > 0 such that 


d 
/ F(ydy-o|«e if |Р›||\<8; 


that is, 
d 
с = є <f F(ydy <o +e if |Р «6. 
с 
This апа (7.2.5) imply that 
d 
sr(P)-e« f F(y)dy < Sy(P) +e if |Р «6, 
c 
and this implies that 
d — 
[ ге »ав.»-е< | Foa s [fedes 027 
с 
(Definition 7.1.4). Since 
| tænde = | f6 946.) 
JR R 
(Theorem 7.1.8) and € can be made arbitrarily small, (7.2.7) implies (7.2.1). [| 


If f is continuous оп R, then f satisfies the hypotheses of Theorem 7.2.1 (Exercise 7.2.3), 
so (7.2.2) is valid in this case. 


If fp f(x. y) d(x, y) and 


d 
[| ДЭ d Sab 
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exist, then by interchanging x and y in Theorem 7.2.1, we see that 


b d 
| af л» = f fo do» 
а с R 
This and (7.2.2) yield the following corollary of Theorem 7.2.1. 


Corollary 7.2.2 If f is integrable on [а,Ь] x [c,d], then 


f a [rena f a [rocas 


provided that [е f (x, y) dy exists fora < x < b and P f (x, y) dx exists forc < y < d. 
In particular, these hypotheses hold if f is continuous on [a, b] x [c, d]. 


Example 7.2.2 The function 


Ро, у) = х+у 


is continuous everywhere, so (7.2.2) holds for every rectangle А. For example, let А = 
[0, 1] x [1, 2]. Then (7.2.2) yields 
1 
dy 
x=0 


2 1 27 732 
| æ+ yac» =f ay | (x + y) dx = / (+++) 
R 1 0 1 2 
A y X 
= — d — — —— 

ж ше ж 
Since f also satisfies the hypotheses of Theorem 7.2.1 with x апа у interchanged, we 
can calculate the double integral from the iterated integral in which the integrations are 
performed in the opposite order; thus, 
2 
dx 
y=1 


_ 1 2 _ 1 у? 

| «+»4е,»= | ax f (+ dy = f [cs 
1 3 x2 3x\ |! 
-[ (+3) A) 


= 2; 


= 2; 
0 


A plausible partial converse of Theorem 7.2.1 would be that if f H dy f, ii f(x. у) dx 
exists then so does fp f(x, y) d(x, y); however, the next example shows that this need not 
be so. 


Example 7.2.3 If f is defined on R = [0, 1] x [0, 1] by 


2xy if y is rational, 
y if y is irrational, 


Дх, у) = 
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then ; 
i Јо, у)ах = у, OSy<1, 
0 
апа 
1 1 1 1 
[af татах | vo 
0 0 0 
However, f is not integrable оп А (Exercise 7.2.7). ш 


The next theorem generalizes Theorem 7.2.1 to К”. 


Theorem 7.2.3 Let Ii, In,..., In be closed intervals and suppose that f is integrable 
on R = I, x I x--x In. Suppose that there is an integer p in {1,2,...,n — 1} such that 
Ер(Хр+1›,Хр+2,..., Хп) = / f Qa. X2... Xn) @(х\, Хә,...,Хр) 

Ij XxlIox--XIp 
exists for each (Xp+1, Xp42, ..., Xn) in Ip+1 X [p42 X +++ X In. Then 


f Fp(Xp+1; Xp+2;---, Хп) d(Xp+1, Хр+2,...,Хп) 
Ip+1XIp42X=XxIn 


exists and equals fg f (X) d X. 


Proof For convenience, denote (x 544, Xp42. ..., Xn) by Y. Denote RST Ki eax 
Ip and T = Ip41 X [p42 XX In. Let P = (R1, Ro, ..., Ry} and = (T1, To,...,Ts} 
be partitions of R and Т, respectively. Then the collection of rectangles of the form R; x Tj 
(1 <i <k,1</j < s)isa partition P of R; moreover, every partition P of R is of this 
form. 


Suppose that 
Y;eT;, 1<j<s, (7.2.8) 
50 
S 
о =) FYJOVG;) (7.2.9) 
j=l 


is a typical Riemann sum of Fp over Q. Since 


F, (Yj) = fo femp МОО: 
R 


k 
E f Qa. X2... Xp, Yj) d(%1, x2... Xp), 
жш, 


J 


(7.2.8) implies that if 
Mij = EE Y) | (x1, X2,..., Xp) € В, Ye Tj 


and 
Mij = sup {f(n X25 +++) Y) | Gs 325-5) eR), Ye Ty 
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then 


k k 
XO my V(Ri) < Е,(Үр) < у Mi V(Ri). 
ї=1 i=1 


Multiplying this by V(T;) and summing from j = 1 to j = s yields 


5 k 5 5 k 
De mj VRIVT) < УР, (ИТ) < У У My VRDVT;), 


ј=1і=1 j=l j=1i=1 
which, from (7.2.9), can be rewritten as 
sr(P) xo x Sy(P), (7.2.10) 


where 5 (Р) and S y (P) are the lower and upper sums of f over P. Now let sp, (Q) and 
Sr, (Q) be the lower and upper sums of Fp over Q; since they are respectively the infimum 
and supremum of the Riemann sums of Fp over Q (Theorem 7.1.5), (7.2.10) implies that 


ss (P) € sg, (Q) < Se, (Q) < Ss P). (7.2.11) 


Since f is integrable оп R, there is for each є > 0 a partition P of R such that S , (P) — 
sf (P) < є, from Theorem 7.1.12. Consequently, from (7.2.11), there is a partition Q of T 
such that Sr, (О) — sr, (Q) < є, so Fp is integrable on Т, from Theorem 7.1.12. 


It remains to verify that 
Í sœax= | F,(Y) aY. (7.2.12) 
R T 
From (7.2.9) and the definition of Sr F,(Y) dY, there is for each € > 0 a ô > 0 such that 


/ F,(Y)dY—o|<e if ||Q\ <6; 
T 


that is, 
о-е< | Кууду «o if 19| <6. 
T 


This and (7.2.10) imply that 
sf(P) – є < J F,(Y)dY < Sy(P) -e if |P|| «6, 
T 


and this implies that 


| fooax-e = [ Е,(Ү)аҮ < f fooax є (7.2.13) 
JR T R 


Since f fX)dX = f f (X) dX (Theorem 7.1.8) and є can be made arbitrarily small, 
R R 
(7.2.13) implies (7.2.12). и 
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Theorem 7.2.4 Let I; = [a;,b;], 1 € j < n, and suppose that f is integrable on 
R= xh X-++x In. Suppose also that the integrals 


ае | /(®) 4 (х1, х2,...,хр), 1<р<п—1, 
I, xI2°xIp 


exist for all 
(Xp4i.---,Xn) in [py XX In. 


Then the iterated integral 


bn bn-1 b2 by 
f ах, | dua f dx2 f(X)dxi 


n—l 1 


exists and equals fg f(X) dX. 


Proof The proofis by induction. From Theorem 7.2.1, the propositionis true forn = 2. 
Now assume n > 2 and the proposition is true with n replaced by n — 1. Holding x; fixed 
and applying this assumption yields 


bn-1 bn—2 b2 bi 
Е, (Xn) =f dna f dina f dxa | РХ) ахі. 
an-1 ün—2 a2 a1 


Now Theorem 7.2.3 with p — n — 1 completes the induction. ш 
Example 7.2.4 Let R = [0,1] x [1, 2] x [0, 1] and 


fo. у,2) = х+у+ 2. 


Then 
x 1 1 
Fi(y,z)— [ eem (mex) Sa TJA 
x=0 
Е 1 
во = | Еу (у, 2) ау = f (5+ +) 4 у 
1 
2 
y y 
= у) = 2+2, 
Е 2 у=1 
апа 
1 1 г? 1 5 
[тезда f Pde = | aod (2+5) =.. m 
R 0 0 2/19 2 


The hypotheses of Theorems 7.2.3 and 7.2.4 are stated so as to justify successive in- 
tegrations with respect to x1, then x2, then x3, and so forth. It is legitimate to use other 
orders of integration if the hypotheses are adjusted accordingly. For example, suppose that 
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{i1,i2,...,i,} is a permutation of {1,2,...,} and /в Р(Х) dX exists, along with 
f SX) а(н Еле, (7.2.14) 
lj, XIj,x-xlij 


for each 
ТО ТРИИ. 9. in lij 44 XHij o Xi X Line (7.2.15) 


Then, by renaming the variables, we infer from Theorem 7.2.4 that 


bi, bi, 4 biz bi, 
E | ib у f ae | /(Х)аху. (1.2.16) 
а а» dii 


ап 


f f(X)dX = 
R in-1 

Since there are n! permutations of {1,2,...,m}, there are n! ways of evaluating a mul- 
tiple integral over a rectangle in IR", provided that the integrand satisfies appropriate hy- 
potheses. In particular, if f is continuous on R and (i1, i2, ..., i4) is any permutation of 
{1,2,...,m}, then f is continuous with respect to (Xj; , Xi, .... Xi;) on Jj, X li; х.х, 
for each fixed Das Xi jua s Xin) Satisfying (7.2.15). Therefore, the integrals (7.2.14) 
exist for every permutation of (1,2,...,7j (Theorem 7.1.13). We summarize this in the 
next theorem, which now follows from Theorem 7.2.4. 


Theorem 7.2.5 If f is continuous on 
R = [ai bi] x [a2, b2] x +++ х [an bn], 


then Ia f (X) dX can be evaluated by iterated integrals in any of the n! ways indicated in 
(1.2.16). 


Example 7.2.5 If f is continuous on R = [ai, b1] x [a2, b2] x [аз, Рз], then 
[fev dea [^ ac f” dy "уе, y.z)dx 
R a3 a2 


= E [oa ^ fes da 


NI ЕЕГ 


1 3 
-f af al Жыз 
a a3 a2 
b 


f(x. y,z) dz 


[В 
-f e f(x. y, z) dz. 
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Integrals over More General Sets 


We now consider the problem of evaluating multiple integrals over more general sets. First, 
suppose that f is integrable on a set of the form 
5 = {(х, y)|uQy) <x <vo) c<y<d} (7.2.17) 


(Figure 7.2.1). 
If u(y) > a and v(y) € b forc < y < d, and 
f(xy), G@yES, 


: E 7.2.18 
fs. у) M (x) 48. ( ) 


then 


J fe a6» = | Бе,» у), 
S R 
where А = [а,Ь] x [c, d].. From Theorem 7 2.1, 


[eae = f a [seas 


provided that f fs(x, y) dx exists for each y in [c,d]. From (7.2.17) апа (7.2.18), this 


integral can be written as 
v) 
f(x, y) dx. (7.2.19) 
u(y) 


Thus, we have proved the following theorem. 


A 
— — ———-y=d 
) y 
icut r=v(y) 
| | 
| 
— ү —-У=с 
| > x 
a b 


Figure 7.2.1 
Theorem 7.2.6 If f is integrable on the set S in (7.2.17) and the integral (7.2.19) 
exists for c € y < d, then 


v(y) 


d 
/ EODLODE | dy | f@.y)ae. (7.2.20) 
S c u(y) 
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From Theorem 7.1.22, the assumptions of Theorem 7.2.6 are satisfied if f is continuous 
on $ and и and v are continuously differentiable on [c, d ]. 


Interchanging x and y in Theorem 7.2.6 shows that if f is integrable on 
5 = {(x,y)| u(x) < y < v(x), a <x <b} (1.2.21) 
(Figure 7.2.2) and 


v(x) 
' f(x, y) dy 


u(x 


exists fora < x < b, then 


v(x) 


b 
[ (e 265 = | dx f(x, y) dy. (7.2.22) 
$ а и(х) 


у= и(х) | 


Figure 7.2.2 


Example 7.2.6 Suppose that 


f(x,y) = xy 


and S is the region bounded by the curves x = y? and x = y (Figure 7.2.3). Since S can 
be represented in the form (7.2.17) as 


S={(@x,y)|y? xsy0zyszi) 


1 y 
( d(x, y) - ay | xy dx, 
S 0 y2 


which, incidentally, can be written as 


1 y 
[аа = |, yay | хах, 
5 0 y2 


(7.2.20) yields 
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since y is independent of x. Evaluating the iterated integral yields 


1 1 
posso o 
2 0 


y 


[vanaf (EP 


Figure 7.2.3 


In this case we can also represent S in the form (7.2.21) as 
S={,y)|x<y </%, 0<x< 1}; 


hence, from (7.2.22), 


Example 7.2.7 To evaluate 


| (x+y) d(x, y), 
S 


where 
S={@,y)|-1<x<1,0<y<1+|x}} 
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(see Example 7.1.11 and Figure 7.2.4), 


Figure 7.2.4 


we invoke Corollary 7.1.31 and write 


[e *»46. 57 f «+»аб,уу+ [ ачаа) 
S 51 So 


where 


Si = {(х,у)|0<х<1,0<у<1+х} 


апа 
5 = {(x,y)| —1<х<0,0<у<1—х} 


(Figure 7.2.5). 
From Theorem 7.2.6, 


Е 1 1+х Е 1 (х + у)? 1+х 
[e *»2e»- [ ax | «+»4у= f = = 
1 
=» | [Qx + 1)? – х?] ах 
0 
-;[Ex- а 
2 6 3 11 
апа 
_ 0 1—х _ 0 (x + у)? 1—x 
[emt [rts [emm fl) 
? 1 x3\ | 1 
== EP = X t 
= fo х“) dx AG 2 2 


Therefore, 
1 7 
[etnde.n=24 =з 
S 3 3 


dx 


Je 
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Figure 7.2.5 


Example 7.2.8 To find the area A of the region bounded by the curves 
y=x74+1 and y29-x? 


(Figure 7.2.6), we evaluate 
A =f а(х, у), 
S 


S = {(x,y)|x?7+1<y <9-x?,-2<x <2}. 


where 


According to Theorem 7.2.6, 


ETFI [(9 —x2) - (x? + 1] dx 


241 -2 
2 2 3 
-[ (8—2x?)dx = (s - E) 
—2 3 


2 64 
> 3 


Figure 7.2.6 
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Theorem 7.2.6 has an analog forn > 2. Suppose that f is integrable on a set S of points 
X = (x1, X2,...,Xn) satisfying the inequalities 


jg Qj. Xp) <xXj <S Uj (X ji... Xn). 1 <j xn-l, 


and 
ап € Xn € bn. 


Then, under appropriate additional assumptions, it can be shown by an argument analogous 
to the one that led to Theorem 7.2.6 that 


bn un(xn) v2(x3,...,Xn) VI (X25 Xn) 
/ ах = | dxa | dna f dx, | РОХ) ахі. 
S ün ип(хп) u2 (X3,....Xn) и16(х2,...,Хп) 


These additional assumptions are tedious to state for general п. The following theorem 
contains a complete statement forn = 3. 


Theorem 7.2.7 Suppose that f is integrable on 
S = {(x, у, 2) | u1, z) < x < 01у, 5), мо) < y < (0), c <z < d}, 
and let 


S(z) = {(х, у) | и(у,2) < x < vi (y, 2), и2(@) < у < v2(z)} 
for each z іп |c, d]. Then 


d v2(z) v1(y,z) 
[fe »240».2- | az | ay f f(x, у,2)ах, 
S [^ u u 


2(z) 10,2) 


provided that 


01(у,2) 
| I(x, y, z)dx 


1652) 
exists for all (y, z) such that 
c<z<d and wz) < y < voz) 
and 


| РО, у, z) d(x, y) 
S(z) 


exists for all z in |c, а]. 


Example 7.2.9 Suppose that f is continuous on the region $ in R? bounded by the 
coordinate planes and the plane 
x+y+2z=2 


(Figure 7.2.7); thus, 
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z 
z 


x+y+2z=1 


Figure 7.2.7 


S = {(x,y,z) |0 <x <2- y- 22, 0<y<2-2z,0<z< 1}. 
From Theorem 7.2.7, 


] fe ».246.».2- [&[ wf f(x,y, z) dx. 


There are five other iterated integrals that equal the multiple integral. We leave it to you 
to verify that 


2 1—y/2 2—y-2z 
] fe »346.».2- | ay | dz f S(x,y, z)dx 


1 2—24 2—x—2z 
=f dz | а f f(x, y,z) dy 
0 0 0 
3 1—x/2 2—x-—2z 
=| ax f az | f(x, y. z) dy 
0 0 0 
2 2—х 1—х/2—у/2 
- [ ax | ay | fx. y. z) dz 
0 0 0 


2 2—y 1—x/2—y/2 
z | ay | ax f fGe.vz)dz m 
0 0 0 


Thus far we have viewed the iterated integral as a tool for evaluating multiple integrals. 
In some problems the iterated integral is itself the object of interest. In this case a result 


(Exercise 7.2.15). 
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like Theorem 7.2.6 can be used to evaluate the iterated integral. The procedure is as follows. 


(a) Express the given iterated integral as a multiple integral, and check to see that the 
multiple integral exists. 


(b) Look for another iterated integral that equals the multiple integral and is easier to 
evaluate than the given one. The two iterated integrals must be equal, by Theo- 
rem 7.2.6. 


This procedure is called changing the order of integration of an iterated integral. 


Example 7.2.10 The iterated integral 


1 y 2 
I = | ay | e CU dx 
0 0 


j 2 bgt as А 
is hard to evaluate because e^ 7" has по elementary antiderivative. The set of points 
(x, y) that enter into the integration, which we call the region of integration, is 


5 = {(х, у) |0<х<у, 0<у<1) 


(Figure 7.2.8). 
y 
y=x 
1 
| 
| 
| 
| 
| 
| 
| 
| » X 
1 
Figure 7.2.8 
Therefore, 
1= | 97 асу), (7.2.23) 
S 


and this multiple integral exists because its integrand is continuous. Since S can also be 
written as 
S={@,y)|x<y<1,0<x< I}, 
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Theorem 7.2.6 implies that 


1 1 1 
| e e» d(x,y) — f ae | dy = -f (x — De 97^ qx 
S 0 x 0 


1 
= 1-0-9? = la — e7!) 
2 o 2 
This and (7.2.23) imply that 
1 
I —-(ü-e1) 
50-67) 


Example 7.2.11 Suppose that f is continuous on [a, oo) and y satisfies the differen- 
tial equation 
y"(x) = f(x), x>a, (7.2.24) 


with initial conditions 
y(a) = y'(a) = 0. 
Integrating (7.2.24) yields 


у(х) = f  Ү? 


since y'(a) = 0. Integrating this yields 


yoy = [as f roa. 


since y(a) = 0. This can be reduced to a single integral as follows. Since the function 
g(s,t) = f() 
is continuous for all (s, t) such that t > a, g is integrable on 
5 = {(з,)|а <<, a<s<x} 
(Figure 7.2.9), and Theorem 7.2.6 implies that 
x M 
/ f(t) d(s,t) = | as f f(t) dt = у(х). (7.2.25) 
S a a 
However, S can also be described as 
S-í(sD|isszxastzx) 


so Theorem 7.2.6 implies that 


Í f(t) d(s,t) = f F(t) dt Га == ГЃе-0л0а. 
S a t a 
Comparing this with (7.2.25) yields 


уб) = | уо) а. 
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t 
A 


Figure 7.2.9 


7.2 Exercises 


1. Evaluate 


(a) f o «+зәах (b) Га [+9 


2л 2, 1022 1 5 
(c) хах f sin xy dy (a) f vay | xe* "dx 
1 0 0 


л/2 


2. Те; = [aj,bj], 1 € j < 3, and suppose that f is integrable on А = Г x Ip х Із. 
Prove: 


(a) If the integral 
bi 
60.0) = | леу. 
аі 


exists for (у, 2) € I5 х Із, then G is integrable on J2 x Із and 


| 1e ».2346.».2- f С(у, z) d(y, 2). 
R InxI3 


(b) If the integral 
н@=] убу.» 
10х12 
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exists for < € /з, then Н is integrable on /з and 


b3 
Je ».246».2- f H(z) dz. 
R a3 


HINT: For both parts, see the proof of Theorem 7.2.1. 


Prove: If f is continuous on [а, b] x [c, d], then the function 


b 
FQ) = f o 


is continuous on [c, d]. HINT: Use Theorem 5.2.14. 


Suppose that 
fy) > Ў, у) if a<x<x <b,c<y<y<d. 


Show that f satisfies the hypotheses of Theorem 7.2.1 on R = [a,b] x [c, 4]. HINT: 
See the proof of Theorem 3.2.9. 


Evaluate by means of iterated integrals: 


(a) [e рабу); R= [0.1] x [L2] 
(b) [ex +з»). у: R = [1,3] x [1,2] 


xy S 
(c) Lon R = (0, 1] x [0, 1] 
(d) [pxcosxycos2xxd(x,y); А = [0,1] х [0.27] 


Let A be the set of points of the form (2 p, 2"), where р апа q аге odd integers 
and m is a nonnegative integer. Let 


1, (x,y) gA, 


fœ = М (x, y) є A. 


Show that f is not integrable on any rectangle R = [a, b] x [c, d], but 


[af feas o | d | леде (b—a)(d—c). (А) 


HINT: For (A), use Theorem 3.5.6 and Exercise 3.5.6. 


Let 
2xy if y is rational, 
y if y is irrational, 


fe. = | 


and R = [0, 1] x [0, 1] (Example 7.2.3). 
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(a) Calculate Ја ЈО, у) d(x, y) and Idi y) d(x, y), and show that f is not 
integrable on R. 


(b) Calculate h (T y) dy) dx and h (fo fo. y) dy) dx. 
8. Le R = [0,1] x [0,1] x [0,1], Ё = [0,1] x (0, 1], and 


2xy + 2xz if y and z are rational, 


f у= у + 2х2 if у is irrational and z is rational, 
лы 2xy +z if y is rational and z is irrational, 

y +z if y and z are irrational. 
Calculate 


(a) [ (646v ana | fov dev 2 


(b) [, (6.2465 and леләр 


(с) [о [лое [а f д | лудак 


9. Suppose that f is bounded on А = [a, b] х [c, d]. Prove: 


b ү pd 
(a) Ж y)d(x, y) < | (/ f(x, Т) dx. HINT: Use Exercise 3.2.6(a). 


> Ab d 
(b) [ fe. y) d(x, y) > f (Ж y) a) dx. HINT: Use Exercise 3.2.6(b). 


10. Use Exercise 7.2.9 to prove the following generalization of Theorem 7.2.1: If f is 
integrable on R = [a, b] x [c, d], then 


Rb d 
[ fone and [ fe» 


are integrable on [a, b], and 


f (rene) == f’ (f reme dx= | fæ da») 


11. Evaluate 
(a) fo — 2y + 3z)d(x, y,z); R = [-2,0] x [2, 5] x [-3,2] 
R 


(b) f e™™ =? sin x sinz d(x,y,z); R = [-1, 1] x [0,2] x [0, 2/2] 
R 


(c) [o +2xz+ yz)d(x,y,z); R = [|-1, 1] x [0, 1] x [- 1. 1] 


12. 


13. 


14. 


15. 


16. 


17. 


18. 
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(d) [ Prem] asy ay R = [0,1] x 0, 1] x (0, 1] 
R 
Evaluate 


(a) [e 46s 5 = {(x,y)|O<x<9-y?,-3<y <3} 


b 2x d(x, ); S is bounded b = x? and x = 2 
S 


c gt a. ; 0S8z-l(x, lo <x <log2y, л/2 < y € x 
Еа y y gy 84y y 

Evaluate fg (x + y) d(x, y), where S is bounded by у = x? and y = 2x, using 

iterated integrals of both possible types. 

Find the area of the set bounded by the given curves. 

(а) у= х2 +9, у 2x?-9, x =-l,x=1 

(b) у= х +2, у= 4-х,х = 0 

(с) х= у2- 4, х= 4 y? 

(d) у=е?^,у=—2х,х=3 


In Example 7.2.9, verify the last five representations of fg f(x, у, z) d(x, y, z) as 
iterated integrals. 


Let S be the region in R* bounded by the coordinate planes and the plane x + 
2y + 3z = 1. Let f be continuous on S. Set up six iterated integrals that equal 


fs Лх, у, z) don y, z). 


Evaluate 


(a) | x d(x, y,zZ); S is bounded by the coordinate planes and the plane 
S 


3x +y+z=2. 


(b) ЕСЕТА {(х,у,)|0<х<1,0<у</х,0О<д< у?) 
$ 


(с) Joao v as 
S 
s-le»2|0oz»zi O<x< у1-у2, 0 <2 < (ery 


(d) [вй yz) S = de» 2| xx ж vz. O<y<z,0<z<1} 
5 


Find the volume of 5. 

(a) 5 is bounded by the surfaces z = x? + y? and z = 8 — x? — y?. 

(b) S = {(x,y,z)| 0 < z < x? + y?, (x, y, 0) is in the triangle with vertices 
(0, 1,0), (0, 0, 0), and (1, 0, 0)} 

(c) ВО а) Оу, 022 227,022 y^ 

(d 5 = {(x,y,z)|x > 0, у20, 0<2<4- 4х2 – 4у2) 
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19. Let R = [ai b2] x [a2, b2] x --- x [an, bn]. Evaluate 
(a) fg G1 + xa +--+ Xn) dX (b) / (x? t+ x +---4+x2) dx 


(c) fp xix2. xn dX 
20. Assuming that f is continuous, express 


P iid d 
Í, yf en) x 


as an iterated integral with the order of integration reversed. 


21. Evaluate f, (x 4- y) d(x, y) of Example 7.2.7 by means of iterated integrals in which 
the first integration is with respect to x. 


1 М1—х2 dy 
22. Evaluate f хах | -———=. 
0 0 Vx? + y? 
23. Suppose that f is continuous on [a, оо), 
у(х) = fG) tza, 


and y(a) = y'(a) =- = уе (a) = 0. 
(a) Integrate repeatedly to show that 


уб) = [а LA des а f” fdn A) 


(b) By successive reversals of orders of integration as in Example 7.2.11, deduce 
from (A) that 


1 x 
у(х) = <a | (x -A7 f(r) dt. 


24. Let T, = [0, p] x [0, p]. p > 0. By calculating 
Қа) = lim / e ?' sinax d(x, y) 
poo JT, 


in two different ways, show that 


© sinax л. 
а х= = if а> 0. 
0 X 2 


7.3 CHANGE OF VARIABLES IN MULTIPLE INTEGRALS 


In Section 3.3 we saw that a change of variables may simplify the evaluation of an ordinary 
integral. We now consider change of variables in multiple integrals. 
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Prior to formulating the rule for change of variables, we must deal with some rather 
involved preliminary considerations. 


Jordan Measurable Sets 


In Section we defined the content of a set S to be 
V(S) — Í dX (7.3.1) 
S 


if the integral exists. If R is a rectangle containing S, then (7.3.1) can be rewritten as 


vis)= f узах, 
R 
where ys is the characteristic function of S, defined by 


09 = |0, xus 


From Exercise 7.1.27, the existence and value of V(S) do not depend оп the particular 
choice of the enclosing rectangle R. We say that S is Jordan measurable if V(S) exists. 
Then V(S) is the Jordan content of S . 


We leave it to you (Exercise 7.3.2) to show that S has zero content according to Defini- 
tion 7.1.14 if and only if S has Jordan content zero. 


Theorem 7.3.1 A bounded set S is Jordan measurable if and only if the boundary of 
S has zero content. 


Proof Let R be a rectangle containing S. Suppose that V(dS) = 0. Since ws is 
bounded оп R and discontinuous only on 05 (Exercise 2.2.9), Theorem 7.1.19 implies that 
f r Ys (X) dX exists. For the converse, suppose that д5 does not have zero content and 
let P = (Ri, Ro,..., Кк} be a partition of R. For each j in {1,2,...,k} there are three 
possibilities: 


1. Rj C S; then 
min {ys (X) |X € Rj} = max(ys(X)|Xe Rj} = 1. 
2. R; NS # Ø and R; N 5 5 0; then 
min(ys(X)| Xe Rj} 20 and max{ys(X)|X€R;}=1. 
3. Rj C S^; then 


min {ys (X) |X € Rj} = max {ys (X)| X € Rj} = 0. 
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Let 
М ={j|R; CS} аа WU-líj|RjnSz9andR;nS* Z9). (7.3.2) 


Then the upper and lower sums of ys over P are 


S(P)= У VR; + Y, VERA 
jeu ПЕТА (7.3.3) 
= total content of the subrectangles in P that intersect S 


and 
s(P)= Y V(R;) 
jeui (7.3.4) 
= total content of the subrectangles in P contained in S. 
Therefore, 


S(P) -s(P) = M5 V(R;), 
jeu» 
which is the total content of the subrectangles in P that intersect both S and S^. Since 
these subrectangles contain 0.5, which does not have zero content, there is an €o > 0 such 
that 
S(P) — s(P) 2 €o 


for every partition P of R. By Theorem 7.1.12, this implies that Ws is not integrable on А, 
so S is not Jordan measurable. " 


Theorems 7.1.19 and 7.3.1 imply the following corollary. 


Corollary 7.3.2 If f is bounded and continuous on a bounded Jordan measurable set 
S, then f is integrable on S. 


Lemma 7.3.3 Suppose that K is a bounded set with zero content and є, p > 0. Then 
there are cubes C1, C2, ..., C, with edge lengths < p such that C; 0 K 0,1 j € r, 


Re |) Ce (7.3.5) 
j=l 


and 


r 

vc) <e. 

j=1 
Proof Since V(K) = 0, 

| Vk(X)dX =0 

С 
if C is any cube containing К. From this and the definition of the integral, there is a ó > 0 
such that if P is any partition of C with ||P || < ó and c is any Riemann sum of x over 


Р, then 
0xocxe. (7.3.6) 
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Now suppose that P = (C1, C5,..., Cx} is a partition of C into cubes with 
|| P || < min(p, ô), (7.3.7) 


and let С, C5, ..., Cy be numbered so that C; N K A 011 <j <randC;NkK=9% 
ifr 4-1 < j < k. Then (7.3.5) holds, and a typical Riemann sum of yx over P is of the 
form 


о = M yk(X)V(Cj) 


j=1 
with X; € Cj, 1 < j < г. In particular, we can choose X; from К, so that wx(X;) = 1, 
and 


г 
о = У`Ү(С;). 
Ј=1 
Now (7.3.6) and (7.3.7) imply that C1, Co, ..., C, have the required properties. ш 


Transformations of Jordan-Measurable Sets 


To formulate the theorem on change of variables in multiple integrals, we must first con- 
sider the question of preservation of Jordan measurability under a regular transformation. 


Lemma 7.3.4 Suppose that G : R” — R” is continuously differentiable оп a bounded 
open set S, and let K be a closed subset of S with zero content. Then G(K) has zero 
content. 


Proof Since К is a compact subset of the open set S, there is a pı > 0 such that the 
compact set 
Kp, = {Х| dist(X, K) x р) 


is contained in S (Exercise 5.1.26). From Lemma 6.2.7, there is a constant M such that 
IG(Y) — G(X)| < M|Y -X| if X,Ye К. (7.3.8) 


Now suppose that € > 0. Since V(K) = 0, there are cubes Ci, C5, ..., С, with edge 
lengths 51, 52, ..., Sr < p1/ уп such that C; N K # 0,1 j <r, 


r 
Ke | Jc, 
j=l 


and 


У VW) ee (7.3.9) 


j=l 
(Lemma 7.3.3). For 1 < j < r,let X; € C; N K. IfX € Cj, then 


IX —-X;| x sj J/n < pı, 
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so X € К and |G(X) - G(X;)| < M|X—X;| < M Jn s;, from (7.3.8). Therefore, G(C; ) 
is contained in a cube C ; with edge length 2M „/п sj, centered at G(X;). Since 
VC у) = QM Vn)" s} = QM Jn) V(C;), 
we now see that 
ў 
с(к)ус\)С, 
j=1 
and 
r ET r 

У (С) < QM ут)" Y V(Cj) < QM Jny'e, 

j=1 j=l 
where the last inequality follows from (7.3.9). Since (2M y/n)” does not depend on є, it 
follows that V(G(K)) = 0. " 


Theorem 7.3.5 Suppose that G : R” — R” is regular on a compact Jordan measur- 
able set S. Then G(S) is compact and Jordan measurable. 


Proof We leave it to you to prove that G(S) is compact (Exercise 6.2.23). Since S 
is Jordan measurable, V(0S) = 0, by Theorem 7.3.1. Therefore, V(G(0S)) = 0, by 
Lemma 7.3.4. But 6(05) = 0(G(S)) (Exercise 6.3.23), so V(0(G(S))) = 0, which 
implies that G(S) is Jordan measurable, again by Theorem 7.3.1. " 


Change of Content Under a Linear Transformation 


To motivate and prove the rule for change of variables in multiple integrals, we must know 
how V(L(S)) is related to V(S) if S is a compact Jordan measurable set and L is a nonsin- 
gular linear transformation. (From Theorem 7.3.5, L(S) is compact and Jordan measurable 
in this case.) The next lemma from linear algebra will help to establish this relationship. 
We omit the proof. 


Lemma 7.3.6 A nonsingular n x n matrix A can be written as 

A-EfE, Ei, (7.3.10) 
where each E; is a matrix that can be obtained from the n x n identity matrix Y by one of 
the following operations: 
(a) interchanging two rows of I; 
(b) multiplying a row of Y by a nonzero constant; 
(c) adding a multiple of one row of Y to another. 


Matrices of the kind described in this lemma are called elementary matrices. The key to 
the proof of the lemma is that if E is an elementary n x n matrix and A is any n x n matrix, 
then EA is the matrix obtained by applying to A the same operation that must be applied 
to I to produce E (Exercise 7.3.6). Also, the inverse of an elementary matrix of type (a), 
(b). or (c) is an elementary matrix of the same type (Exercise 7.3.7). 


The next example illustrates the procedure for finding the factorization (7.3.10). 
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Example 7.3.1 The matrix 
0 1 1 
A=; 1 0 1 
2 2 0 
is nonsingular, since det(A) = 4. Interchanging the first two rows of A yields 


1 0 1 
Ai2| 0 1 1 | 2 EiA, 
220 


where 


Ffi=] 100 
0 0 1 


Subtracting twice the first row of A; from the third yields 


1 0 1 "Pd 
Аз = | 0 1 1 = E;E,A, 
0 2 -2 
where 
» 100 
E = 0 1 0 
—2 0 1 


Subtracting twice the second row of Аз from the third yields 


1 0 1 PISO 
Аз= | 0 1 1 | = E3E.E,A, 
0 0 —4 
where 
" 1 0 0 
Ез=| 0 1 0 
0 —2 1 
Multiplying the third row of Аз by -i yields 
1 0 л а 
А1= | 0 1 1 | = B4A3E2E,A, 
0 0 1 
where 
" 1 0 0 
Е4= | 0 1 0 
0 0 —4 
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Subtracting the third row of A4 from the first yields 


100 
As—-| 0 1 1 | 2 ESALE;E;E,A, 
0 0 1 
where 
1 0 -1 
E;—-|0 1] 0 
00 1 


~A AAA AK KX 


where 


~ RAR ARR XK 


Therefore, 
А = EgE;E4E3E2E;, 
where 
m 1 0 0 = 1 1 
E; = ВЕ = 0 1 14, E = Ee = 0 1 0 |, 
0 0 1 0 1 
nu 1 0 0 nu 1 0 
E; = Ау! = 0 1 0 |, Ey = E! = 0 1 0 |, 
0 0 —4 0 1 
n 100 2 0 1 0 
E; = E! = 0 1 0 |, Es = E! = 1 0 0 
2 0 1 0 0 1 
(Exercise 7.3.7 (c)). 


(7.3.11) 


Lemma 7.3.6 and Theorem 6.1.7(c) imply that an arbitrary invertible linear transforma- 


tion L : R” — R”, defined by 
X = L(Y) = AY, 
can be written as a composition 
L= Lz o Lg} o.. ol, 


where 
L(Y) = Е;Ү, 1<i<k. 


(7.3.12) 


(7.3.13) 
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Theorem 7.3.7 If S is а compact Jordan measurable subset of R” and L : R” — R” 
is the invertible linear transformation X = L(Y) = AY, then 


V(L(S)) = | det(A)|V(S). (7.3.14) 
Proof Theorem 7.3.5 implies that L(S) is Jordan measurable. If 
V(L(R)) = | det(A)|V(R) (7.3.15) 


whenever R is a rectangle, then (7.3.14) holds if S is any compact Jordan measurable 
set. To see this, suppose that € > 0, let R be a rectangle containing S, and let Р = 
(R4, Ro,..., Ёк} be a partition of R such that the upper and lower sums of ys over P 
satisfy the inequality 

S(P) —s(P) «e. (7.3.16) 


Let U, and U2 be as in (7.3.2). From (7.3.3) and (7.3.4), 
s(P)= 3 V(Rj)< VIS) < M VR) M У(Ё;) = S(P). (7.3.17) 
jeu, jeu jeu» 
Theorem 7.3.7 implies that L(R1), L(R2), ..., L(Ry) and L(S) are all Jordan measurable. 
Since 
U R; CSC U Rj, 
jeuy JE81U82 
it follows that 
L| U RJCLOCcL| U к, 
nau Јє81082 
Since L is one-to-one on IR", this implies that 
XO va) vas) s Y vaa» У Vai). (7.3.18) 
jeu jeu; jeu» 
If we assume that (7.3.15) holds whenever R is a rectangle, then 
V(L(8;)) = |det(A)|V(Rj), 1<j <k, 


so (7.3.18) implies that 


V(L(S)) 
sU) = ea) $90 


This, (7.3.16) and (7.3.17) imply that 


V(L(S)) 


V6) 7 TA] 


< є; 


hence, since є сап be made arbitrarily small, (7.3.14) follows for any Jordan measurable 
set. 
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To complete the proof, we must verify (7.3.15) for every rectangle 
R = [ay, bı] x [a2, b2] x +++ x |an, bn] = Ty Xx I2 X x Tn. 
Suppose that A in (7.3.12) is an elementary matrix; that is, let 
X = L(Y) = EY. 
CASE 1. If E is obtained by interchanging the ith and jth rows of I, then 


yr ifr Aiandr Æj; 
Xr = yj ifr =i; 
y ifr=j. 
Then L(R) is the Cartesian product of 71, 72, ..., In with J; and 7; interchanged, so 
V(L(R)) = V(R) = |det(E)|V(R) 
since det(E) = —1 in this case (Exercise 7.3.7(a)). 
CASE 2. If E is obtained by multiplying the rth row of I by a, then 


_ fyr ifr Ail, 


x ; 
4 ay; ifr = і. 


Then 
Si eh oe ee жы 
where // is an interval with length equal (о |a| times the length of J;, so 
V(L(R)) = |a|V(R) = | det(E)|V(R) 


since det(E) = a in this case (Exercise 7.3.7(a)). 
CASE 3. If E is obtained by adding a times the jth row of I to its ith row (j Z i), then 


a Dr ifr Æi; 
|у tay; ifr=i. 


Then 
L(R) = {(х1,хә,..., Xn) | ai + axj € xi € bj c ax; anda, < xr < Біг z ij, 


which is a parallelogram if n = 2 and a parallelepiped if n = 3 (Figure 7.3.1). Now 
V(L(R)) = |. ах, 
L(R) 


which we can evaluate as an iterated integral in which the first integration is with respect 
to x;. For example, ifi = 1, then 


bn bn-1 bo bi +ax; 
V(L(R)) =f dxa | duas f dx, | ахі. (7.3.19) 


n—l 1+ax j 
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Since 
by +ax; bi 
f dy, = dyi, 
a 


1taxj а 


(7.3.19) сап be rewritten as 


bn bn-1 b2 bi 
V(L(R)) - | dx, | duas f ахә ахі 


n—i 2 а 


= (bn — an)(bn—1 — Gn—1) +++ (bı — a1) = V(R). 


Hence, V(L(R)) = | det(E)| V(R), since det(E) = 1 in this case (Exercise 7.3.7(a)). 


Figure 7.3.1 
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From what we have shown so far, (7.3.14) holds if A is an elementary matrix and 5 is 


any compact Jordan measurable set. If A is an arbitrary nonsingular matrix, 
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then we can write A as a product of elementary matrices (7.3.10) and apply our known 
result successively to Ly, L2, ..., Lg (see (7.3.13)). This yields 


V(L(S)) = | det(Ex)| | det(Ex_1)|---| de E,|V(S) = | det(A)|V(S), 


by Theorem 6.1.9 and induction. ш 


Formulation of the Rule for Change of Variables 


We now formulate the rule for change of variables in a multiple integral. Since we are for 
the present interested only in “discovering” the rule, we will make any assumptions that 
ease this task, deferring questions of rigor until the proof. 


Throughout the rest of this section it will be convenient to think of the range and domain 
of a transformation G : IR" — IR" as subsets of distinct copies of IR". We will denote the 
copy containing Dg as E”, and write G : E” — R” and X = С(Ү), reversing the usual 
roles of X and Y. 

If G is regular on a subset S of E”, then each X in G(S) can be identified by specifying 
the unique point Y in S such that X — G(Y). 

Suppose that we wish to evaluate f; т J (X) dX, where T is the image of a compact Jordan 
measurable set S under the regular transformation X — G(Y). For simplicity, we take S to 
be a rectangle and assume that f is continuous on T = G(S). 

Now suppose that Р = (Rj, Ro,..., Rx} is a partition of S and T; = G(R;) (Fig- 
ure 7.3.2). 


sz 


y 


Figure 7.3.2 
Then 
k 
| тооах = MI f(X) ax (7.3.20) 
T fay YT) 


(Corollary 7.1.31 and induction). Since f is continuous, there is a point X; in T; such that 


| f(X) dX = /(Х)) / dX = f(X;)V(T;) 
Tj Tj 
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(Theorem 7.1.28), so (7.3.20) can be rewritten as 


k 
f годах = Y xp). (7.3.21) 


j-1 
Now we approximate V(T;;). If 
X; = G(Yj), (7.3.22) 
then Y; € Rj and, since С is differentiable at Y j, 
G(Y) x G(Y;) + G'(Yj)(Y - Y). (7.3.23) 


Here G and Y — Y; are written as column matrices, G’ is a differential matrix, and zz" 
means "approximately equal" in a sense that we could make precise if we wished (Theo- 
rem 6.2.2). 


It is reasonable to expect that the Jordan content of G(R;) is approximately equal to the 
Jordan content of A(R;), where A is the affine transformation 


A(Y) = G(Y;) + G'(Y;)(Y - Ү;) 
on the right side of (7.3.23); that is, 
V(G(R;)) = V(A(R;)). (7.3.24) 

We can think of the affine transformation A as a composition A = Аз o A2 o Aq, where 

А (Ү = Ү- Ү;, 

A2(Y) = G'(Y j)Y, 

and 
A3(Y) = G(Y;) + Y. 


Let К”, = А! (Rj). Since A, merely shifts R; toa different location, К”, is also arectangle, 
and - | 


Ү(К') = V(Rj). (7.3.25) 


Now let К” = А›(К”). (In general, R” is not a rectangle.) Since A» is the linear transfor- 
mation with nonsingular matrix G'(Y ;), Theorem 7.3.7 implies that 


V(R^)) = | det G'(Y ;)| V(R^) = |JG(Y j)|V(R;). (7.3.26) 


where JG is the Jacobian of G. Now let R?” = A3(R7). Since Аз merely shifts all points 
in the same way, | | 
V(R') = V(R')). (7.3.27) 


Now (7.3.24)-(7.3.27) suggest that 
V(T;) © |JG(Y;)|V(8;). 
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(Recall that Т; = G(R;).) Substituting this and (7.3.22) into (7.3.21) yields 


k 
[ах У лет) va. 


j=1 


But the sum on the right is a Riemann sum for the integral 
Јело. 
which suggests that 
[А РОХ) ах = | f(G(Y)|JG(Y)| dy. 


We will prove this by an argument that was published in the American Mathematical 
Monthly [Vol. 61 (1954), pp. 81-85] by J. Schwartz. 


The Main Theorem 


We now prove the following form of the rule for change of variable in a multiple integral. 


Theorem 7.3.8 Suppose that G : E" — R" is regular on a compact Jordan measur- 
able set S and f is continuous on G(S). Then 


| f(X)dX = ri f(G(Y)|JG(Y)| dY. (7.3.28) 
G(S) S 


Since the proof is complicated, we break it down to a series of lemmas. We first observe 
that both integrals in (7.3.28) exist, by Corollary 7.3.2, since their integrands are continu- 
ous. (Note that S is compact and Jordan measurable by assumption, and G(S) is compact 
and Jordan measurable by Theorem 7.3.5.) Also, the result is trivialif V(S) = 0, since then 
V(G(S)) = 0 by Lemma 7.3.4, and both integrals in (7.3.28) vanish. Hence, we assume 
that V(S) > 0. We need the following definition. 


Definition 7.3.9 If A = [a;j] is ann x n matrix, then 


n 
max Уу laij||1<i<n 


j=1 


is the infinity norm of A, denoted by || Alloo. 


Lemma 7.3.10 Suppose that G : E" — R” is regular on a cube С in E”, and let A be 
a nonsingular n x n matrix. Then 


V(G(C)) < | det(A)| [max {|| A7!G/(¥) loo | Y e CH” V(C). (7.3.29) 
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Proof Let s be the edge length of C. Let Yo = (c1, c2, ..., Cn) be the center of С, and 
suppose that Н = (y1, у2,..., yn) € C. If Н = (Ai, h2, ..., An) is continuously differen- 
tiable on C, then applying the mean value theorem (Theorem 5.4.5) to the components of 
H yields 
n 

oh; (Y) 
h;(Y) - hi(Yo) = >> 7 

j 


j=l 


(уре 1<ї<п, 


where Ү; € С. Hence, recalling that 
д^; |" 
H' (Y) = ЕЗ 
ду; i,j=l 
applying Definition 7.3.9, and noting that |y; —c;| < s/2, 1 € j < п, we infer that 
5 І 
|hi(Y) — hi(Yo)| < 5 max (19У) |У ЄС). 1 <и. 
This means that H(C) is contained in а cube with center Хо = H(Yo) and edge length 
s max {||H’(Y)|loo | Y e С}. 


Therefore, 
V(H(C)) < [max (|H'(Y)ls4]" |Y e Cj s" 


n (7.3.30) 
= [max (CY oo]” | Y € С) VC). 


Now let 
L(X) = АХ 


апа set H = Lo С; then 
Н(С) =L(G(C)) and H —A'!G', 

so (7.3.30) implies that 

V(L(G(C)) < [max (A^! G'(Y)lls | Y e С}] VIC). (7.3.31) 
Since L is linear, Theorem 7.3.7 with A replaced by A^! implies that 

V(L(G(C))) = |det(A) ! |V(G(C)). 
This and (7.3.31) imply that 
| det(A~!)|V(G(C)) < [max (A^! G'(Y)|ls | Y e C}]" (C). 

Since det(A~!) = 1/ det(A), this implies (7.3.29). E 


Lemma 7.3.11 /f G : E" — R” is regular on a cube C in R”, then 


V(G(C)) < f eoa. (7.3.32) 
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Proof Let P bea partition of C into subcubes С, C5, ..., Cy with centers Y1, Yo,..., 
Yz. Then 
k 
V(G(C) = У V(G(C;). (7.3.33) 
j=l 


Applying Lemma 7.3.10 to C; with = G'(A ;) yields 
V(G(C;)) < |JG(Y j)] [max (I(G'(Y;j))  G'(Y)ls | Ye GH’ V(Cj). 0.3.34) 
Exercise 6.1.22 implies that if € > 0, there is a ô > 0 such that 
тах (|(С'(Ү ;)) !G'(Y)l»|YeC;j) «1e, 1<j<k, if ||P «8. 
Therefore, from (7.3.34), 
V(G(C;)) = @ + 9"|JG(Y j)|V(C;). 
so (7.3.33) implies that 


k 
V(G(C) < (1+ 6)" У 1G )V(C;) if Р «8. 


j=1 


Since the sum on the right is a Riemann sum for fo |J G(Y)| d Y and є can be taken arbi- 
trarily small, this implies (7.3.32). ш 


Lemma 7.3.12 Suppose that S is Jordan measurable апа є, p > 0. Then there are 
cubes Cy, Co, ..., C, in S with edge lengths < p, such that C; C S, 1x j € т, 
CP NC? = Gifi + j, and 


V(S) < XC V(Cj) +e. (7.3.35) 
Ј=1 


Proof Since S is Jordan measurable, 
[ vseax = уб) 
C 


if C is any cube containing 5. From this and the definition of the integral, there isa ô > 0 
such that if Р is any partition of C with ||P || < ô and c is any Riemann sum of ws over 
Р, ћепо > V(S) — є/2. Therefore, if s(P) is the lower sum of Ys over P, then 


5(Р) > И(5) –є if |Р «6. (7.3.36) 
Now suppose that Р = (C1, С,..., Ск} is a partition of C into cubes with ||P|| < 
min(p, ô), and let Cy, C2, ..., Cy be numbered so that C; C S if1 < j < r and 


C; N 5% ifj > г. From (7.3.4), s(P) = ae V(C). This and (7.3.36) imply 
(7.3.35). Clearly, C? n C? = Øifi F j. ш 
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Lemma 7.3.13 Suppose that G : E" — R” is regular on a compact Jordan measur- 


able set S and f is continuous and nonnegative on G(S). Let 


oc = | fon dx - | FEIEN dv. (7.3.37) 
G(S) S 


Then Q(S) x 0. 


Proof From the continuity of JG and f on the compact sets S and G(S), there are 
constants Му and М» such that 


\JG(Y)| <M, if Yes (7.3.38) 


and 
|/(X) < Mo if XeG(S) (7.3.39) 


(Theorem 5.2.11). Now suppose that є > 0. Since f o G is uniformly continuous on 5 
(Theorem 5.2.14), there is a ó > O such that 


| f(G(Y)) - f(G(Y))| «e if |Y—Y'| « óand Y, Y' є S. (7.3.40) 
Now let С, C5, ..., С, be chosen as described in Lemma 7.3.12, with p = 6/./n. Let 


ме ено) 


Ј=1 
Then V(S1) < € and 


$ = (U J U S4. (7.3.41) 


Suppose that Y1, Y2,..., Y, are points in C1, C2, ..., С, and X; = G(Y;), 1 € j <r. 
From (7.3.41) and Theorem 7.1.30, 


Q(S) = [| ух)ах- f FGODIJGOY)| dY 
G(S1) $1 
+ X) dx — G(Y))| JG(Y)| dY 
a ) X^ (Ү))|7б(Ү)| 
= f fX)dX- f f(G(Y)JGO)| dY 
G(S1) S1 
+ X) — f(A;)) dX 
э [ c, UO LAD 
p [ (GOE; — AGOGO) dY 
jeu 


+у fp (ree - | veo x) . 
j=l 


J 
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Since f(X) > 0, 
[ (oie ania = 0. 
51 
апа Lemma 7.3.11 implies that the last sum is nonpositive. Therefore, 
O(S)<ht+h4+h, (7.3.42) 
where Я 
n-[. уодах, ъ= у f 1с – лах, 
G(S1) j=l G(C;) 
and 


be» |, |/(GYY /)) - £(G)IJ 6(Ү)| dY. 
j=l J 


We will now estimate these three terms. Suppose that e > 0. 
To estimate Г, we first remind you that since С is regular on the compact set S, С is 


also regular on some open set © containing S (Definition 6.3.2). Therefore, since $4 С S 
and V(S1) < є, Sı can be covered by cubes T1, 75, ..., Tm such that 


У`И(Т;) <є (7.3.43) 
ј=1 
апа С is regular on ( J7.., Ту. Now, 
I, < M3V(G(S1)) (from (7.3.39)) 
< м M V(G(T;) (since Sı C U"_, Tj) 


Ј=1 
т 
< M5 5f |/G(Y)| dY (from Lemma 7.3.11) 
+ T; 
j=l J 
< М»М,є (from (7.3.38) and (7.3.43)). 


To estimate /2, we note that if X and X; are in G(C;) then X = G(Y) and X; = G(Y;) 
for some Y and Y; in Су. Since the edge length of C; is less than ó/ n, it follows that 
|Y — Yj| < 6, so| f(X) — f(X;)| < e, by (7.3.40). Therefore, 


I; <e у V(G(C;)) 


Ј=1 


O) |JG(Y)|dY (from Lemma 7.3.11) 
jai? Gi 


< єМү Y V(C;) (from (7.3.38)) 
j=l 
<eM,V(S) (since U5 ., C; C S). 
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To estimate /3, we note again from (7.3.40) that | f(G(Y;)) — f(G(Y))| < e if Y and 
Yj; are in Су. Hence, 


Із <є / | JG(Y)|dY 
2. С; 


< Mie У V(C;) (бот (7.3.38) 
Ј=1 
< MiV(S)e 


because [ J., C; C S and C? N C? = fifi zj. 


From these inequalities on Г, I2, and 75, (7.3.42) now implies that 
O(S) < Mi(M2 + 2V(S))e. 
Since € is an arbitrary positive number, it now follows that Q(S) < 0. " 


Lemma 7.3.14 Under the assumptions of Lemma 7.3.13, Q(S) 7 0. 


Proof Let 
Gi=G"'!, 5 = 6(5), л = (ЈС) об, (7.3.44) 


апа 


Qi) = [А o Aay- | fiGi(X)|JG X)| dX. (7.3.45) 


Since G, is regular on 5; (Theorem 6.3.3) and fı is continuous and nonnegative on 
Gı (S1) = S, Lemma 7.3.13 implies that Q;(S,) < 0. However, substituting from (7.3.44) 
into (7.3.45) and again noting that Су (S1) = S yields 


Qi$) = [ f(G()1JGQ)| dY 


(7.3.46) 
Е Ж f(G(G^ (X)))|JG(G"! (X))||JG"! (X)| dX. 


Since G(G^! (X)) = X, /(G(G^! (X))) = f(X). However, it is important to interpret the 
symbol JG(G~! (X)) properly. We are not substituting G^! (X) into G here; rather, we are 
evaluating the determinant of the differential matrix of G at the point Y = G^! (X). From 
Theorems 6.1.9 and 6.3.3, 


JG(G XIJG (X)| = 1, 
so (7.3.46) can be rewritten as 
os = | foizeoniav- | fooax =-0(5). 
S G(S) 


Since Q1($1) < 0, it now follows that O(S) > 0. H 
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We can now complete the proof of Theorem 7.3.8. Lemmas 7.3.13 and 7.3.14 imply 
(7.3.28) if f is nonnegative on S. Now suppose that 


m = min { f(X) |X e G(S)} < 0. 


Then f — m is nonnegative on G(S), so (7.3.28) with f replaced by f — m implies that 
S —m)dX= Јов —m)|JG(Y)| aY. (7.3.47) 
G 


However, setting f = 1 in (7.3.28) yields 


Í ax= | |JG(Y)| dy, 
G(S) S 


so (7.3.47) implies (7.3.28). E 


The assumptions of Theorem 7.3.8 are too stringent for many applications. For example, 
to find the area of the disc 


13 |x +y <1}, 


itis convenient to use polar coordinates and regard the circle as G(S), where 


r cos Ө 
G(r, 0) = | sth | (7.3.48) 
and S is the compact set 
5 = {(r,0)|0<r<1,0<6<27} (7.3.49) 


(Figure 7.3.3). 


2n 


X-Gt(r Ө) 
————- 


>r 


= 


Figure 7.3.3 
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Since 


G'(r,0) = | cos@ —гвїп@ 1. 


8100  rcos0 


it follows that JG(r, 0) = r. Therefore, formally applying Theorem 7.3.8 with f = 1 


yields 
1 2л 
а= | ax = | raco = | гаг 10 = л. 
G(S) S 0 0 


Although this is a familiar result, Theorem 7.3.8 does not really apply here, since G(r, 0) — 
G(r,21),0 € г < 1, so С is not one-to-one on S, and therefore not regular on S. 

The next theorem shows that the assumptions of Theorem 7.3.8 can be relaxed so as to 
include this example. 


Theorem 7.3.15 Suppose that G : E" — R” is continuously differentiable on a 
bounded open set N containing the compact Jordan measurable set S, and regular on 
S9. Suppose also that G(S) is Jordan measurable, f is continuous on G(S), and G(C) is 
Jordan measurable for every cube C C N. Then 


f f(X)dxX = Í f(G(Y)|JG(Y)| dY. (7.3.50) 
G(S) S 
Proof Since f is continuous on G(S) and (|J G|) f oG is continuous on S, the integrals 
in (7.3.50) both exist, by Corollary 7.3.2. Now let 

p — dist (0S, N^) 


(Exercise 5.1.25), and 
| p 
P =3Y | dist(Y, 0S)! < —. 
(Y | ачу, д5)} < 5 


Then P is a compact subset of N (Exercise 5.1.26) and 0S C p? (Figure 7.3.4). 
Since S is Jordan measurable, (д5) = 0, by Theorem 7.3.1. Therefore, if € > 0, we 


can choose cubes C1, C5, ..., Cy in P? such that 
k 
as c| Jc? (1.3.51) 
j=1 
and 
k 
у, Ү(С;) <€ (7.3.52) 


Ј=1 


Now let S, be the closure of the set of points in S that are not in any of the cubes С, 
C2, ..., Cy; thus, 


81= 8 П (0551). 
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Because of (7.3.51), $1 П 0S = 0, so Sı is a compact Jordan measurable subset of So. 
Therefore, G is regular оп $1, and f is continuous on G(S1). Consequently, if О is as 
defined in (7.3.37), then Q (S1) = 0 by Theorem 7.3.8. 


95 


© 


М = open set bounded by outer curve 
S = closed set bounded by inner curve 


Figure 7.3.4 
Now 


Q(S) = 0(51) + 0(5 N 51) = Q(S П ST) (7.3.53) 
(Exercise 7.3.11) and 


|Q(S п SDI < + 


| fX)dX 
G(SNS¢) 


f f(G» aqoa. 
sns¢ 
But 


| i f(G(Y)|JG(Y)| aY| < MiM3V(S п 5), (7.3.54) 
Snst 


where Mı and Mp are as defined in (7.3.38) and (7.3.39). Since 5 П SẸ С Ut Су, 
(7.3.52) implies that V(S N Sk) « €; therefore, 


| f f(G(Y)|JG(Y)| d¥| < MiM»e, (7.3.55) 
SASS 
from (7.3.54). Also 
k 
| f(X)dX| x M3V(G(S n S{)) < М» > V(G(C;)). (7.3.56) 
G(SNS¢) 71 
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By the argument that led to (7.3.30) with H = С and C = Cj, 
V(G(C;)) < [max {6V | Y € Су}]' ИСС). 


so (7.3.56) can be rewritten as 


| f (X) dX} < М» [max (IIG'(Y)]les | Y € P}]"e, 

G(SNS¢) 

because of (7.3.52). Since € can be made arbitrarily small, this and (7.3.55) imply that 
O(S N ST) = 0. Now Q(S) = 0, from (7.3.53). ш 


The transformation to polar coordinates to compute the area of the disc is now justi- 
fied, since G and S as defined by (7.3.48) and (7.3.49) satisfy the assumptions of Theo- 
rem 7.3.15. 


Polar Coordinates 


If G is the transformation from polar to rectangle coordinates 


| : | = G(r, 6) = | FEE |; (7.3.57) 


г ѕіп Ө 


then J G(r, 0) = r and (7.3.50) becomes 
| F(x, у)4(х,у) = / f(r cos 0, ғ зїп Ө)г d(r, 0) 
G(S) S 


if we assume, as is conventional, that S is in the closed right half of the r@-plane. This 
transformation is especially useful when the boundaries of S can be expressed conveniently 
in terms of polar coordinates, as in the example preceding Theorem 7.3.15. Two more 
examples follow. 


Example 7.3.2 Evaluate 


_ 2 
I = |е y d, У), 


where T is the annulus 
Т = {(x,y)|1<x?+y? <4} 


(Figure 7.3.5(b)). 


Solution We write T = G(S), with G as in (7.3.57) and 


S={¢,0)|1<r<2,0<6<2n} 


506 Chapter 7 Integrals of Functions of Several Variables 
(Figure 7.3.5(a)). Theorem 7.3.15 implies that 
І = [e cos? 0 + r sin Ө)г d(r, Ө), 
S 
which we evaluate as an iterated integral: 
2 2л 
r= | r*dr (r cos? 0 + sin 0) d0 
1 0 
2 2л r r 1 
= / Par | ( + = cos 20 + sin 0) 40 | since cos? 0 = – (1 + cos 20) 
1 0 2 2 2 


2 0 2л 2 4 
=f ro ТУ d in) =сбв8 dr=x | me all 
1 gl 2 4 0 1 4 


0— 
2n 


ч 


(а) (b) 
Figure 7.3.5 


Example 7.3.3 Evaluate 
r= | уау), 
T 


where T is the region in the x y-plane bounded by the curve whose points have polar coor- 
dinates satisfying 
r=l—cos0é, 0<0<x 


(Figure 7.3.6(b)). 


Solution We write T = G(S), with G as in (7.3.57) and S the shaded region in 
Figure 7.3.6(a). From (7.3.50), 


I = [е sin 0)r d (r, 0), 
8 
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which we evaluate as an iterated integral: 


л 1—cos 0 1 л 
1= | sino do | па f (1 — cos 0)? sin 0 46 
0 0 3 Jo 


л 


1 
= — (1 — cos 0)* 
12 0 


(a) (b) 
Figure 7.3.6 


Spherical Coordinates 


If G is the transformation from spherical to rectangular coordinates, 


x r cos Ө cos ф 
y |=G(r,6,¢) = | rsin0cosQ |, (7.3.58) 
Z r sin ġ 


then 
cosÜcosQ -—r sin соф —r cos 0 sin 


G'(r,0,ġ) = | sinOcosQ rcos@cosd -~r sin® sinġ 
sing 0 rcos@ 


and JG(r, 0, 9) = г? cos ф, so (7.3.50) becomes 


f rodena 
G(S) 
(7.3.59) 


= | flr cos cos d. r sind cos d. r sing)r? cos bdr 0.9) 
S 


if we make the conventional assumption that || < 2/2 andr > 0. 
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Example 7.3.4 Leta > 0. Find the volume of 


2 


T = {(x,y,z)|x7+y? +z? <a’, x>0, y>0, > 0}, 


which is one eighth of a sphere (Figure 7.3.7(b)). 


(b) 
Figure 7.3.7 


Solution We write T = G(S) with G as in (7.3.58) and 


S = {(r,0,6)|0<r <a, 0< 0 < л/2,0<ф < 2/2} 
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(Figure 7.3.7(a)), and let f = 1 ір (7.3.59). Theorem 7.3.15 implies that 


E Е 2 
ит) = f x= f cos ф d(r, 0, ф) 


a л/2 z/2 a3 л za? 
E 2 Z E 
= / r ar f ao | созф dọ = (5) (5) (7.3.1) = =. 


Example 7.3.5 Evaluate the iterated integral 


a Ма2—х2 A a2—x2—y2 
r=] хах f ay | zdz (a>0). 
0 0 0 


Solution We first rewrite J as a multiple integral 


I =f xz d(x, у, 2) 
G(S) 


where G and S are as in Example 7.3.4. From Theorem 7.3.15, 


I= fe cos 0 cos $) (r sin $)(r? cos $) d(r, 0, ф) 
S 
a л/2 z/2 a> 1 a> 
= 4 2 i = — — —— 
=Í r ar f cosa 46 | cos“ ф sing dọ = ( =) 3. (5) Ti 


Other Examples 


We now consider other applications of Theorem 7.3.15. 
Example 7.3.6 Evaluate 
I= fe + 4y) d(x, у), 
where T is the parallelogram bounded by the lines 
х+у= 1, x+y=2, x—2y=0, and x—2y=3 
(Figure 7.3.8 (b)). 


Solution We define new variables u and v by 


u _ _ х+у 
чыыр 
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A 
3 Sa 
X 
$ = Е(и,у) 
y 
— 
AE ced »u 
2 
(a) 
y 
A 


(b) 
Figure 7.3.8 


Then 
2u+v 
x т) 
[5 =en = "OPI 
3 
2 i 1 
=í = 3 3 EE 
JF TE al 3 
3 3 


and T = F~! (S), where 


S={u,v)|1<u<2,0<v<3} 
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(Figure 7.3.8(a)). Applying Theorem 7.3.15 with G = F^! yields 


[ C —.—G ) to. е | шз v) 
n a f (2и —v)du = = aL © -w| 
-1 f e-va=i (2-2) 


Example 7.3.7 Evaluate 


I 


[ 


dv 
=1 


3 
o 2 
I= [ee + y?) d(x, y), 


where T is the annulus T = {(x, y) |a? < x? + y? < b?} witha > 0 and b > 0 (Fig- 
ure 7.3.9(a)). 


>< 


(a) (b) 
Figure 7.3.9 


Solution The forms of the arguments of the exponential functions suggest that we 
introduce new variables u and v defined by 


u x?— y? 
MEINE 


and apply Theorem 7.3.15 to G = F~!. However, F is not one-to-one on T° and therefore 
has no inverse on T° (Example 6.3.4). To remove this difficulty, we regard T as the union 
of the quarter-annuli T1, T2, 73, and T4 in the four quadrants (Figure 7.3.9)(b)), and let 


i= | ee XY px? y? uz + y?) d(x, y). 
T 


J 
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Since the pairwise intersections of Тү, T2, Тз, and T4 all have zero content, / = J, + 
Т» + 13 + I4 (Corollary 7.1.31). Theorem 7.3.8 implies that / = h = Гз = Ц (Exer- 
cise 7.3.12), so J = 41. Since J; does not contain any pairs of distinct points of the form 
(хо, Yo) and (—xo, —yo), F is one-to-one on Ту (Example 6.3.4), 


Е(Т,) = $ = {(и, о) |а < u? +02 < bt, v > 0} 


(Figure 7.3.10(b)), 


(a) (b) 
Figure 7.3.10 


and a branch G of F^! can be defined on Sı (Example 6.3.8). Now Theorem 7.3.15 implies 
that 


l= | ee XY uy uz + y2)|JG(u, v)| d(u, v), 
51 
where x and y must still be written in terms of u and v. Since it is easy to verify that 
JF(x, y) = 4? + y?) 


and therefore 


1 
JG(u, v) =, 
(5) = ауд) 
doing this yields 
1 
i= i e+" (и, v). (7.3.60) 
4 Js, 


To evaluate this integral, we let p and o be polar coordinates in the uv-plane (Figure 7.3.11) 


and define H by 
u | _ | peosa |. 
| v |= нра) =| psing 1: 


then Sı = H(S}), where 


Si = (P.a) |a? <p <b’, 0<a<z} 
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(Figure 7.3.10(a)); hence, applying Theorem 7.3.15 to (7.3.60) yields 


I 


un 


1 2 1 2 
= L e^ |JH(p, о) d(p,o) = 1 р pe?" d(p, a) 
4 8 4 81 

4 


1 л b2 b^ а 
= J da | pe? dp = prre 
4 0 az 8 


4 


те zc" — e^), 


hence, 


(и, v) 


Figure 7.3.11 


Example 7.3.8 Evaluate 
T= f e¥1tx2 Xn d (x1, X2, D Xp), 
T 


where T is the region defined by 


ai <&ху+хо+ + Sbi, 1<ї<п. 


Solution We define the new variables у, y2,..., Yn by Y = F(X), where 
fX) = x +x + +x, lsxiszn. 
If G = F^! then T = G(S), where 
S = [41,0] x [a2, b2] x --- x [an, bn], 


and JG(Y) = 1, since JF(X) = 1 (verify); hence, Theorem 7.3.8 implies that 
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1. 


1= | edn. yas) 
S 


bi b2 bn—1 bn 
al dyı dya [ dyn | е?" dy, 
ai a? an-1 an 


= (by — a1) (bo — a2) ++ (bn-1 — ani) (e^ — e°”). 


7.3 Exercises 


Give a counterexample to the following statement: If S? and S» are disjoint subsets 
of a rectangle R, then either 


| vsœwax f 05,00 4Х = | Vsus Q0 dX 
R R R 
or 


f vscoax f Vs Q0dX = | asus Q0 4X. 
ZR ZR ZR 


Show that a set E has content zero according to Definition 7.1.14 if and only if E 
has Jordan content zero. 


Show that if Sı and 52 are Jordan measurable, then so are S1 U Sz and S11 S5. 

Prove: 

(а) If S is Jordan measurable then so is S, and V(S) = V(S). Must 5 be Jordan 
measurable if S is? 

(b) IfT is a Jordan measurable subset of a Jordan measurable set S, then 5 — T 
is Jordan measurable. 


Suppose that Н is a subset of a compact Jordan measurable set S such that the inter- 
section of H with any compact subset of S? has zero content. Show that V(H) = 0. 


Suppose that E is an n x n elementary matrix and A is an arbitrary n x p matrix. 
Show that EA is the matrix obtained by applying to A the operation by which E is 
obtained from the n x n identity matrix. 


(a) Calculate the determinants of elementary matrices of types (a), (b), and (c) 
of Lemma 7.3.6. 


(b) Show that the inverse of an elementary matrix of type (a), (b), or (c) is an 
elementary matrix of the same type. 


(c) Verify the inverses given for E;,.. . , Es in Example 7.3.1. 
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8. Write as a product of elementary matrices. 


1 0 I 2 3 -2 
(a)| 1 1 0 (b)! 0 -1 5 
0 1 1 0 —2 4 
9. Suppose that ad—bc zz 0, иу < uz, and vı < v2. Find the area of the parallelogram 
bounded by the lines 


ax + by =, ax + by = из, 
cx + dy = 01, cx + dy = v2. 
10. Find the volume of the parallelepiped defined by 


1<2x+3y-2z<2, 5<-x+5y<7, 1<-2x+4y <6. 


11. In writing Eqn. (7.3.53) we assumed that 


fX)dX = [ " f(®%)dX+ [ F(X) dX. 


G(S) (50150) 


Justify this. HINT: Show that G(S1) N G(S N ST) has zero content. 
12. Use Theorem 7.3.8 to show that / = h = 1з = I4 in Example 7.3.7. 
13. Lete; = +1,0 <i x n. Let T be a bounded subset of R” and 


T- {(e1x1, 2X2, . .. en Xn) | (Сань) € Т}. 
Suppose that f is defined оп Т and define g on T by 
g(e1X1. C2X2,...,€nXn) = eo f (X1, Х2,..., Xn). 


(a) Prove directly from Definitions 7.1.2 and 7.1.17 that f is integrable on T if 
and only if g is integrable on Т, and in this сазе 


[sx -— Í f(X) aX. 


(b) Suppose that T = T, 
f (e1x1. €2X2,.--,€nXn) = — f (X1. Х2,..., Xn), 
and f is integrable on Т. Show that 


ri f(X)aX = 0. 


14. Епа the area of 
(а) {(х, у) |у<х<4у, 1 x-2y < 3); 
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(b) {œ,y)|2 < xy <4, 2x < y < 5x}. 
15. Evaluate 
f (3x? + 2y + 2) d(x, у, 2), 
Т 


where 
T = {(x,y,2)||x—yl <1, |y- z| Sh ietxl< 1j. 


16. Evaluate 
Jo? 23946.» 
T 
where T is the region bounded by the curves 
xy=1, xy=2, yx? у=х?+1. 
17. Evaluate 
е-е аб, у), 
T 
where T 15 the region in the first quadrant bounded by the hyperbolas 


xy=1, xy=2, x?-y?=2, x-y = 3. 


18. Find the volume of the ellipsoid 


х2 y g 
zZ vast (a,b,c > 0). 
19. Evaluate 
ex ty? +27 


PTT MA 


T = {(x, y, z) |9 < x? + y? +22 < 25). 


where 


20. Find the volume of the set T bounded by the surfaces z = 0, z = Vx? + у?, and 
x? + у? = 4. 
21. Evaluate 
Оз — у“) d(x, у, 2), 


where 
T = {(x,y,z)|1<x?-y? <2, 3 < x? +y? <4, 0<z<1}. 


22. Evaluate 
v2 /4—›° dx 4 а 
а а — b dx ех Y 4 
(a) y y 
0 y 0 0 


1 +x? +y? 


1 V1—x2 Jf 1—x2—y2 
ofa] 2а: 
-1 —V1—x2 0 
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23. Use the change of variables 


XI r cos 01 cos 05 cos Өз 
X2 r sin 6; cos 05 cos Өз 
X3 = Gr, 61,02, 6з) = r sin 05 cos 05 

X4 r sin 05 


to compute the content of the 4-ball 
T= {(x1, X2, х3, x4) | x7 + x2 + xe + KG < art 


24. Suppose that A = [ajj] is a nonsingular n x n matrix and T is the region in IR" 
defined by 


0j < ахі + diaXa ts + dinXn < Bi, A Sin. 


(a) Find V(T). 
(b) Show that if c1, c2, ..., Cn are constants, then 


| Уя; ax = YD yas + В), 


j= i=1 
where 
di €1 
^ ау 
d, cn 


25. If V, is the content of ће n-ball T = {х | |X| < 1}, find the content of the n- 
dimensional ellipsoid defined by 


Sue 


ч. 
- 


Leave the answer in terms of V}. 


CHAPTER 8 


Metric Spaces 


IN THIS CHAPTER we study metric spaces. 


SECTION 8.1 defines the concept and basic properties of a metric space. Several examples 
of metric spaces are considered. 


SECTION 8.2 defines and discusses compactness in a metric space. 


SECTION 8.3 deals with continuous functions on metric spaces. 


8.1 INTRODUCTION TO METRIC SPACES 


Definition 8.1.1 A metric space is a nonempty set A together with a real-valued func- 
tion p defined on A x A such that if u, v, and w are arbitrary members of A, then 


(а) p(u,v) > 0, with equality if and only if u = v; 

(b) plu, v) = p(v. u); 

(c) р(и, о) € plu, ш) + p(w, v). 

We say that p is a metric on A. " 


If n > 2 and u1, u2, ..., Un are arbitrary members of A, then (c) and induction yield 
the inequality 


n-i 


pti Un) < È plui, uii). 


i=1 


Example 8.1.1 The set R of real numbers with p(u, v) = |u — v| is a metric space. 
Definition 8.1.1 (c) is the familiar triangle inequality: 


lu — v| € |u — w| + |w — ш. и 
Motivated by this example, in an arbitrary metric space we call p(u, v) the distance from 


u to v, and we call Definition 8.1.1(c) the triangle inequality. 
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Example 8.1.2 If A is an arbitrary nonempty set, then 


( = 0 ifu=v, 
Pe = |р ғизо 


is a metric on A (Exercise 8.1.5). We call it the discrete metric. E 


Example 8.1.2 shows that it is possible to define a metric on any nonempty set A. In 
fact, it is possible to define infinitely many metrics on any set with more than one member 
(Exercise 8.1.3). Therefore, to specify a metric space completely, we must specify the 
couple (A, p), where A is the set and p is the metric. (In some cases we will not be so 
precise; for example, we will always refer to the real numbers with the metric р(и, v) = 
|u — v| simply as R.) 

There is an important kind of metric space that arises when a definition of length is 
imposed on a vector space. Although we assume that you are familiar with the definition 
of a vector space, we restate it here for convenience. We confine the definition to vector 
spaces over the real numbers. 


Definition 8.1.2 A vector space A is a nonempty set of elements called vectors on 
which two operations, vector addition and scalar multiplication (multiplication by real 
numbers) are defined, such that the following assertions are true for all U, V, and W in 
A and all real numbers r and s: 


1U+VeEA; 
2.U+V=V+U; 
3.U+(V+W) = (0 + У) + М; 
4. There is a vector 0 in A such that 0 + 0 = U; 
5. There is a vector —U in A such that U + (—U) = 0; 
6. rU € A; 
7.r(UU+V)=rUe4+ry; 
8. (r + s)U = rU + 50; 
9. r(sU) = (rs)U; 
10. IU = U. ш 


We say that A is closed under vector addition if (1) is true, and that A is closed under 
scalar multiplication if (6) is true. It can be shown that if B is any nonempty subset of A 
that is closed under vector addition and scalar multiplication, then B together with these 
operations is itself a vector space. (See any linear algebra text for the proof.) We say that 
B isa subspace of A. 


Definition 8.1.3 A normed vector space is a vector space A together with a real-valued 
function N defined on A, such that if и and v are arbitrary vectors in A and a is a real 
number, then 


(a) N(u) > 0 with equality if and only if u = 0; 
(b) Маи) = |а|М(и); 
(c) N(u +v) < NQ) + N(v). 


We say that N is a norm on A, and (А, №) is a normed vector space. 
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Theorem 8.1.4 /f (A, N) is a normed vector space, then 
p(x, y) = N(x — y) (8.1.1) 
is a metric on A. 
Proof From (a) with u = x — у, p(x, y) = N(x — y) > 0, with equality if and only 
if x = y. From (b) with u = x — y and a = —1, 
ply, x) = NO х) = NCC — y)) = № — y) = р(х, у). 
From (c) withu = x — z and v = z — y, 


р(х, y) = М(х— у) < N(x =z) + N(z у) = p(x.z) + p(z, y). 


We will say that the metric in (8.1.1) is induced by the norm N. Whenever we speak of 
a normed vector space (A, N), it is to be understood that we are regarding it as a metric 
space (А, p), where p is the metric induced by N. 


We will often write N (u) as ||u||. In this case we will denote the normed vector space as 
(A, || - |. 
Theorem 8.1.5 /f x and y are vectors in a normed vector space (A, N), then 
IN(x) - N(y)| < Мх — y). (8.1.2) 
Proof Since 
x=y+(x—y), 
Definition 8.1.3(c) with u = y and v = x — y implies that 
N(x) < NQ) + Nx -= у), 


Or 
N(x) - NO) s N(x — y). 


Interchanging x and y yields 
N(y) - N(x) s NQ -= x). 


Since N(x — y) = N(y — x) (Definition 8.1.3(b) with u = x — y and a = —1), the last 
two inequalities imply (8.1.2). E 


Metrics for R” 


In Section 5.1 we defined the norm of a vector X = (x1, X2,...,Xn) in R” as 


IXI = (E) 


i=1 
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The metric induced by this norm is 


5 1/2 
ax» = (Yo =w) 


i=1 


Whenever we write R” without identifying the norm or metric specifically, we are referring 
to IR” with this norm and this induced metric. 


The following definition provides infinitely many norms and metrics on R”. 


Definition 8.1.6 If p > 1 and X = (x1, X2,..., Xn), let 


n 1/p 
XI, = (>: sr) | (8.1.3) 


i=1 


The metric induced on R” by this norm is 


n 1/p 
pp(X. Y) = (Y: |х; - ni?) : 5 


i=1 


To justify this definition, we must verify that (8.1.3) actually defines a norm. Since it is 
clear that ||X|| p > 0 with equality if and only if X = 0, and ||aX]||p = |a|||X||p if a is any 
real number and X є R”, this reduces to showing that 


IX + Yl» < [Х| + 11 (8.14) 


for every X and Ү їп К”. Since 
[xi + yil S lxil |02, 


summing both sides of this equation from i = 1 ton yields (8.1.4) with p = 1. To handle 
the case where p > 1, we need the following lemmas. The inequality established in the 
first lemma is known as Hólder's inequality. 


Lemma 8.1.7 Suppose that ui, ро, ... , п and v1, v2, ... , vy are nonnegative numbers. 
Let p > 1 andq = p/(p — 1); thus, 
1 1 
– + – = 1. (8.1.5) 
р q 


Then 
n n 1/p n 1/q 
у umi < (x и) (x 0) . (8.1.6) 
i=1 
Proof Let « and f be any two positive numbers, and consider the function 


yj af eus 
р Я 
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where we regard o as a constant. Since //(8) = В! —o and f"(B) = (q—1)04? > 0 
for В > 0, f assumes its minimum value on [0, оо) at В = a!/@-) = 2-1. But 


p (p—1)q 1 1 
jue er -a =a? (42-1) =0. 


p 
Therefore, 
а? pI 
ab < — + — if a,p>0. (8.1.7) 
P q 
Now let 
—1/р —1/4 
п п 
ор = ш ун? and fj — vj $ vi 
j- J= 
From (8.1.7), 
-1 -1 


ES 
E 
© 
= 


From (8.1.5), summing this from i = 1 ton yields У? o/;B; < 1, which implies (8.1.6). 
a 


Lemma 8.1.8 (Minkowski’s Inequality) Suppose thatu,,u2,...,Un and vi, 
Uo sss Un are nonnegative numbers and p > 1. Then 


" 1/р п 1/р п 1/p 
рэй 4 n) < (Y: 7 + (Y: и) А (8.1.8) 
і=1 і=1 і=1 
Proof Again, let = p/(p — 1). We write 
n n n 
Y ui + о)? = V ui (ui + vi)! + у vi lui vi). (8.1.9) 
і=1 і=1 і=1 
From Hólder's inequality with ш; = и; and vj; = (uj + vj)?-l, 
n n 1/p n 1/q 
uiui +o)? < (хм) рэй + n”) À (8.1.10) 
і=1 і=1 і=1 
since q(p — 1) = p. Similarly, 


n n 1/p n 1/q 
у, vi (ui + vj)?! < (x n) рэй + 24 . 


This, (8.1.9), and (8.1.10) imply that 


n n 1/p n 1/р п 1/9 
Уш + uj)? < (> 4) us p» n) (5 + n) . 


i=1 i=1 i=1 
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Since 1 — 1/9 = 1/p, this implies (8.1.8), which is known as Minkowski’s inequality. W 
We leave it to you to verify that Minkowski’s inequality implies (8.1.4) if p > 1. 


We now define the co-norm on R” by 
[Хө = max {|x;||1 <i <n}. (8.1.11) 


We leave it to you to verify (Exercise 8.1.15) that || - |22 is a norm on R”. The associated 
metric is 
poo (X, Y) = max {|x; — у; | | 151 <n}. 


The following theorem justifies the notation in (8.1.11). 


Theorem 8.1.9 /fX є R” and p; > pi = 1, then 


IXIlp; < XII pi: (8.1.12) 
moreover, 
lim |X|p = max {|x;||1 x i € nj. (8.1.13) 
poo 
Proof Letu;, u», ..., Un be nonnegative and M = max (ui | l<i< n). Define 


n 1/p 
o(p) = (>: 4) ; 


i=1 


Since u;/o(p) x 1 and p2 > pi, 


u; X м; MP 
(ст) > (25) | 


sn n i pi\ VPI n те paN VPI 
olp) _ (> (zs) ) Е (>; (zs) ) =a 


so o(p1) > o(pa). Since M < o(p) < MnVP, limp-+o0 o (p) = M. Letting u; = |xi| 
yields (8.1.12) and (8.1.13). | 


Since Minkowski's inequality is false if p < 1 (Exercise 8.1.19), (8.1.3) is not a norm in 
this case. However, if 0 « p < 1, then 


n 
ІХ = Y xil? 


i=1 


therefore, 


is anorm on R” (Exercise 8.1.20). 


Vector Spaces of Sequences of Real Numbers 


In this section and in the exercises we will consider subsets of the vector space IR^? con- 
sisting of sequences X = {х; }? 1, with vector addition and scalar multiplication defined 
by 

Х+Ү={х + усу and rX = {их}. 
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Example 8.1.3 Suppose that 1 < p < оо and let 


oo 
lp 2 AX e R? | У |х: <= | 
і=1 
Геї 
оо 1/р 
ХІІ, = (X sr) | 
і=1 
Show that (£p, || |1) is a normed vector space. 


Solution Suppose that X, Y € £p. From Minkowski's inequality, 
n 1/p n 1/p n 1/p 
(Eite) = (и) «Qr 
i=l i=1 i=l 

for each n. Since the right side remains bounded as n — oco, so does the left, and 

oo 1/p oo 1/p oo 1/p 

p |х: + ») < » ar) + (> »r) | (8.1.14) 
i=1 і=1 і=1 


ѕоХ+Ү є £p. Therefore, £ is closed under vector addition. Since £p is obviously closed 


under scalar multiplication, £p is a vector space, and (8.1.14) implies that || - |; is a norm 
on £p. a 
The metric induced by || - || p is 


оо 1/р 
pp(X, Y) = (X: |x; - vt) І 


i=1 
Henceforth, we will denote (£p, || - ||) simply by £p. 
Example 8.1.4 Let 


loo = {KE R” | {x;}?2, is bounded} . 


Let 
Х| = sup (1xil |i = 1). 
We leave it to you (Exercise 8.1.26) to show that (£s, || - loo) is а normed vector space. NI 
The metric induced by || · || oo is 


Poo(X, Y) = sup {|x — yil |i > 1}. 


Henceforth, we will denote (£, || ||) simply by Loo. 


Section 8.1 Introduction to Metric Spaces 525 


Familiar Definitions and Theorems 


At this point you may want to review Definition 1.3.1 and Exercises 1.3.6 and 1.3.7, which 
apply equally well to subsets of a metric space (A, p). 


We will now state some definitions and theorems for a general metric space (A, p) that 
are analogous to definitions and theorems presented in Section 1.3 for the real numbers. To 
avoid repetition, it is to be understood in all these definitions that we are discussing a given 
metric space (A, p). 


Definition 8.1.10 If uo € A and є > 0, the set 
Ne(uo) = {ue A | oluo, и) <e} 


is called an €-neighborhood of ug. (Sometimes we call Se the open ball of radius € centered 
at ug.) If a subset S of A contains an e-neighborhood of uo, then S is a neighborhood of 
Ug, and uo is an interior point of S. The set of interior points of S is the interior of S, 
denoted by S?. If every point of S is an interior point (that is, S° = S), then S is open. A 
set S is closed if 5° is open. 


Example 8.1.5 Show that if r > 0, then the open ball 
S,(uo) = (ue A | p(uo,u) <r} 


is an open set. 


Solution We must show that if м1 € 8, (ио), then there is an e > 0 such that 
Se(u1) С S, (ug). (8.1.15) 
If и € S, (uo), then р(иџ, ug) < г. Since 


р(и, uo) € p(u,u1) + pui. uo) 


for апу u in A, p(u,uo) < r if p(u,u1) < r — p(u1, ио). Therefore, (8.1.15) holds if 
€ <r — p(u1, uo). ш 

The entire space A is open and therefore Ø (= А) is closed. However, Ø is also open, 
for to deny this is to say that it contains a point that is not an interior point, which is absurd 
because Ø contains no points. Since Ø is open, A (= 9°) is closed. If A = R, these are the 
only sets that are both open and closed, but this is not so in all metric spaces. For example, 
if p is the discrete metric, then every subset of A is both open and closed. (Verify!) 


A deleted neighborhood of a point uo is a set that contains every point of some neigh- 
borhood of uo except uo itself. (If p is the discrete metric then the empty set is a deleted 
neighborhood of every member of A!) 


The proof of the following theorem is identical to the proof Theorem 1.3.3. 
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Theorem 8.1.11 
(a) The union of open sets is open. 


(b) The intersection of closed sets is closed. 


Definition 8.1.12 Let S be a subset of A. Then 
(a) uoisa limit point of S if every deleted neighborhood of uo contains a point of S. 


(b) uo is a boundary point of S if every neighborhood of uo contains at least one point 
in S and one not in S. The set of boundary points of S is the boundary of S, denoted 
by 0S. The closure of S, denoted by S, is defined by 5 = S U 05. 


(c) uo is an isolated point of S if ug € S and there is a neighborhood of uo that contains 
no other point of S. 


(d) uo is exterior to S if uo is in the interior of S^. The collection of such points is the 
exterior of S. a 


Although this definition is identical to Definition 1.3.4, you should not assume that con- 
clusions valid for the real numbers are necessarily valid in all metric spaces. For example, 
if A = R and p(u, v) = |u — v|, then 


5,(ио) = {и | olu, ug) < ‘ae 
This is not true in every metric space (Exercise 8.1.6). 
For the proof of the following theorem, see the proofs of Theorem 1.3.5 and Corol- 


lary 1.3.6. 


Theorem 8.1.13 A set is closed if and only if it contains all its limit points. 


Completeness 


Since metric spaces are not ordered, concepts and results concerning the real numbers that 
depend on order for their definitions must be redefined and reexamined in the context of 
metric spaces. The first example of this kind is completeness. To discuss this concept, we 
begin by defining an infinite sequence (more briefly, a sequence) in a metric space (A, p) as 
a function defined on the integers n > k with values in A. As we did for real sequences, we 
denote a sequence in A by, for example, {un} = {и} „. A subsequence of a sequence 
in A is defined in exactly the same way as a subsequence of a sequence of real numbers 
(Definition 4.2.1). 


Definition 8.1.14 A sequence {un} in a metric space (A, p) converges tou € A if 
lim p(un, u) = 0. (8.1.16) 
n—oo 
In this case we say that „> Un = и. B 


We leave the proof of the following theorem to you. (See the proofs of Theorems 4.1.2 
and 4.2.2.) 
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Theorem 8.1.15 


(a) The limit of a convergent sequence is unique. 


(b) Flm Un = u, then every subsequence of {un} converges to u. 


Definition 8.1.16 A sequence {un} in a metric space (A, p) is a Cauchy sequence if 
for every є > 0 there is an integer N such that 


р(иһ, иһ) <є and т,п> М. (8.1.17) 
ш 


We note that if p is the metric induced by a norm || - || on A, then (8.1.16) and (8.1.17) 
can be replaced by 
lim ||u, = u| = 0 
п->со 


апа 
ln —ums| «e and m,n>N, 


respectively. 


Theorem 8.1.17 Ifa sequence {uy} in a metric space (А, p) is convergent, then it is 
a Cauchy sequence. 


Proof Suppose that lim; оо Un = u. Ife > 0, there is an integer N such that 
plun, и) < e/2if n > N. Therefore, if m, n > №, then 


plun, um) < р(иһ, и) + р(и, Um) < €. 
ш 


Definition 8.1.18 A metric space (A, р) is complete if every Cauchy sequence in A 
has a limit. 


Example 8.1.6 Theorem 4.1.13 implies that the set R of real numbers with p(u, v) 
= |u — v| is a complete metric space. [| 


This example raises a question that we should resolve before going further. In Section 1.1 
we defined completeness to mean that the real numbers have the following property: 


Axiom (I). Every nonempty set of real numbers that is bounded above has a supremum. 


Here we are saying that the real numbers are complete because every Cauchy sequence 
of real numbers has a limit. We will now show that these two usages of "complete" are 
consistent. 
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The proof of Theorem 4.1.13 requires the existence of the (finite) limits inferior and 
superior of a bounded sequence of real numbers, a consequence of Axiom (I). However, 
the assertion in Axiom (Т) can be deduced as a theorem if Axiom (I) is replaced by the 
assumption that every Cauchy sequence of real numbers has a limit. To see this, let T be a 
nonempty set of real numbers that is bounded above. We first show that there are sequences 
{uj }P2, and {v;}?2, with the following properties for alli > 1: 
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(a) и; < t forsome t € T and v; > t for allt € Т; 
(b) (vi — ui) x 277! (v1 — ui). 
(c) Ui X Mig] S Vi4i S Vi 


Since T is nonempty and bounded above, u; and v, can be chosen to satisfy (a) with 
i = 1. Clearly, (b) holds with = 1. Let wy = (и + v1)/2, and let 


е ш 01) if шу < t for some t € T, 

, (иі, w1) ifw,;>tforallt € T. 
In either case, (a) and (b) hold with i = 2 and (c) holds with i = 1. Now suppose that 
n > land {u1,..., un} and (vi,..., Un} have been chosen so that (a) and (b) hold for 
1 <i <n and (с) holds for 1 < i < n — 1. Let wn = (Un + Un)/2 and let 


(Wn, Vn) ifw, < t for somet c T, 


(Un+1; Un+1) = |? Wn) ifw,>tforallt € T. 


Then (a) and (b) hold for 1 < i < n + 1 and (c) holds for 1 < i < n. This completes 
the induction. 


Now (b) and (c) imply that 
О<ш+ — u; <2) "(uy — u1) and Oxvw-viz2 11-1), izl. 


By an argument similar to the one used in Example 4.1.14, this implies that {u;}°2, and 
{ш }?2, are Cauchy sequences. Therefore the sequences both converge (because of our 
assumption), and (b) implies that they have the same limit. Let 

lim uj = lim v; = f. 

La OO: 1->со 
If t € T, then v; > t for alli, so В = іп оо vj > t; therefore, f is an upper bound of 


Т. Now suppose that є > 0. Then there is an integer № such that uy > f — є. From the 
definition of и y, there is a ty in T such that ty > иу > B – є. Therefore, B = supT. M 


Example 8.1.7 (The Metric Space C[a,b]) Let C [a, b] denote the set of all 
real-valued functions f continuous on the finite closed interval [a, b]. From Theorem 2.2.9, 
the quantity 


ПА = max {fœ |a <x <b} 


is well defined. We leave it to you to verify that it is a norm on C [a, b]. The metric induced 
by this norm is 


eCf.g) = 17 — gl = max {| f(x) -gœ |a <x < b}. 


Whenever we refer to C[a, b], we mean this metric space or, equivalently, this normed 
linear space. ш 

From Theorem 4.4.6, a Cauchy sequence ( fn} in C [a, b] converges uniformly to а func- 
tion f on [a, b], and Corollary 4.4.8 implies that f is in C [a, b]; hence, C [a, b] is complete. 
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The Principle of Nested Sets 
We say that a sequence {Ту} of sets is nested if Т, + С Т, for all n. 


Theorem 8.1.19 (The Principle of Nested Sets) A metric space (A, p) is 
complete if and only if every nested sequence {Tn} of nonempty closed subsets of A such 
that limy—+oo d(Tn) = 0 has a nonempty intersection. 


Proof Suppose that (А, р) is complete and (7,) is a nested sequence of nonempty 
closed subsets of A such that limy—+ 9) 4(Т,) = 0. For each n, choose tn € Ta. If m > n, 
then tm, tn € Tn, so p(fn, tm) < d(T4). Since lim, o5 d(Tn) = 0, {tn} is a Cauchy se- 
quence. Therefore, limy—+o9 f, = f exists. Since f is a limit point of Т, and Tn is closed 
for all n, f € Т, for all n. Therefore, ? € NX; Tn; in fact, 7? Т, = {Т}. (Why?) 

Now suppose that (A, p) is not complete, and let {t,} be a Cauchy sequence in A that 
does not have a limit. Choose nı so that p(tn,tnı) < 1/2ifn > nı, and let Т = 
{t | P(t. tni) < 1}. Now suppose that j > 1 and we have specified n1, n2, ..., Nj—1 
and Ту, T5, ..., Tj-1. Choose n; > пу] so that Dn. tn; ) «27 ifn > nj, and let 
T; = {t | P(t,tn;) < 2771), Then T; is closed and nonempty, T;j+ı С Ту for all j, 
and limj+oo d(T;) = 0. Moreover, t, € T; ifn > nj. Therefore, if t € m T, 
then p(t,,f) < 2-і n > nj, SO liMn>oofn = f, contrary to our assumption. Hence, 
NSZ Ty = 0. 


Equivalent Metrics 


When considering more than one metric on a given set A we must be careful, for example, 
in saying that a set is open, or that a sequence converges, etc., since the truth or falsity of 
the statement will in general depend on the metric as well as the set on which it is imposed. 
In this situation we will alway refer to the metric space by its “full name;" that is, (A, p) 
rather than just A. 


Definition 8.1.20 If p and о are both metrics on a set A, then p and c are equivalent 
if there are positive constants œ and f such that 


< Р(х,у) <В forall х,ує А suchthat xy. (8.1.18) 
о(х, у) 


Theorem 8.1.21 If pando are equivalent metrics оп a set A, then (A, р) and (А, о) 
have the same open sets. 


Proof Suppose that (8.1.18) holds. Let S be an open set in (A, p) and let xo € S. Then 
there is an є > 0 such that x € S if р(х, хо) < e, so the second inequality in (8.1.18) 
implies that xo € S if o (x, хо) < є/ В. Therefore, S is open in (А, о). 

Conversely, suppose that S is open in (А, о) and let хо € S. Then there is an e > 0 
such that x € S if o(x, xo) « e, so the first inequality in (8.1.18) implies that xo € S if 
p(x, xo) < ea. Therefore, S is open in (A, р). " 
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Theorem 8.1.22 Any two norms № and № on R” induce equivalent metrics on R". 
Proof It suffices to show that there are positive constants œ and f such 


Nı (X) . 
< М(Х) <p if X40. (8.1.19) 


We will show that if N is any norm on К”, there are positive constants ay and by such 
that 
aw|Xlla € NÆ) < |х| if X40 (8.1.20) 


and leave it to you to verify that this implies (8.1.19) witha = ам, /by, and В = by, /any. 


We write X — Y = (x1, X2,..., Xn) as 


n 
X-Y = J (Qu — yi)E;, 


i=1 


where E; is the vector with ith component equal to 1 and all other components equal to 0. 
From Definition 8.1.3(b), (c), and induction, 


n 
NX- Y) < У xi — vil N (Ej); 
i=1 
therefore, by Schwarz’s inequality, 


N(X — Y) < K||X—Yllo, (8.1.21) 


where 


" 1/2 
K= (x ve) 
i=1 
From (8.1.21) and Theorem 8.1.5, 
INX) — N(Y)| x KIX — Yl. 


so N is continuous on К» = R”. By Theorem 5.2.12, there are vectors Оу and U2 such 
that |10: 12 = ||U2|/2 = 1, 


N(Ui) = min (N(U) | 1012 = 1}, and N(U2) = max (N(U) |1012 = 1}. 


Ifay = N(Ui) and by = N(U2), then ay and by are positive (Definition 8.1.3(a)), and 


X 
ах <N (=) «by if X40. 
Хә 


This and Definition 8.1.3(b) imply (8.1.20). и 


We leave the proof of the following theorem to you. 
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Theorem 8.1.23 Suppose that p and o are equivalent metrics on A. Then 
(a) A sequence {un} converges to u in (A, p) if and only if it converges to u in (A, о). 


(b) A sequence {иһ} is a Cauchy sequence in (A, p) if and only if it is a Cauchy sequence 
in (A, о). 


(с) (A, р) is complete if and only if (A, о) is complete. 


8.1 Exercises 


1. Show that (a), (b), and (c) of Definition 8.1.1 are equivalent to 
(1) p(u, v) = Oif and only if u = v; 
(ii) olu, v) < р(ш,и) + p(w, v). 


2. Prove: If x, y, u, and v are arbitrary members of a metric space (A, p), then 
р(х, у) — plu, v)| < p(x, u) + pv, у). 


3. (a) Suppose that (A, p) is a metric space, and define 


plu, v) 


P9) 7 T pu) 


Show that (A, p1) is a metric space. 


(b) Show that infinitely many metrics can be defined on any set A with more than 
one member. 


4. Let (A, p) be a metric space, and let 


_ pu v) 
о(и, v) = —————. 
1+ plu, v) 

Show that a subset of A is open in (A, p) if and only if it is open in (A, c). 


5. Show that if A is an arbitrary nonempty set, then 


0 ifv=u, 
PME. А 
is a metric on A. 
6. Suppose that (A, p) is a metric space, uo € A, andr > 0. 
(a) Show that 5, (uo) C {и | р(и, ио) < r} if A contains more than one point. 
(b) Verify that if p is the discrete metric, then Sj (uo) # {и | ou, uo) < 1}. 


10. 


12. 


13. 


14. 


15. 


16. 
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Prove: 

(a) The intersection of finitely many open sets is open. 

(b) The union of finitely many closed sets is closed. 

Prove: 

(a) IfU isa neighborhood of uo and U C V, then V is a neighborhood of uo. 
(b) I£fU;, U2, ..., Un are neighborhoods of uo, so is П? ,U;. 

Prove: A limit point of a set S is either an interior point or a boundary point of S. 
Prove: An isolated point of S is a boundary point of S°. 

Prove: 

(a) A boundary point of a set S is either a limit point or an isolated point of S. 
(b) A set S is closed if and only if 5 = 5. 

Let S be an arbitrary set. Prove: (a) 05 is closed. (b) S? is open. (c) The exterior 
of S is open. (d) The limit points of S form a closed set. (e) (S) KS 


Prove: 

(a) (S1 N S2)? = S? N SL (b) S? U S? C (S1 U S2)? 
Prove: 

(a) 3(Sı U S2) C 3S1 U 3S2 (b) 3(S1 N S2) C 3S1 U 3S2 
(c) 9$ c aS (d) aS = д5° 

(е) 005 Т) c daSU dT 

Show that 


Х| = maxt|xi]. [x2]. -. -> |х|) 
is a norm on К”. 
Suppose that (A;, pj), 1 € i < k, are metric spaces. Let 
A= Ay x Aa x x Ag = {X = (x1, X2,..., Xk) | xi € Ai, 1 <i <k}. 
If X and Y are in A, let 


k 
p(X, Y) = ) р(х, yi). 


i=1 


(a) Show that p is a metric on A. 
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17. 


18. 


(b) Let {X,}9, = (Gars X2r,---,Xkr) $22, be a sequence in A. Show that 


lim X, = X = (%1,%2,..., Xx) 
r—0o 
if and only if 
lim xir = Xj, 1<i<k. 
r—oo 


(c) Show that {X,}92, is a Cauchy sequence in (A, p) if and only if {x;,}2, isa 
Cauchy sequence in (A;, pj), 1 € i € К. 

(d) Show that (A, p) is complete if and only if (A;, pi) is complete, 1 < i < k. 

For each positive integer i, let (A;, pj) be a metric space. Let A be the set of all 

objects of the form X = (x1, х2,..., Xn, ... ), where x; € Aj, i > 1. (For example, 

if A; = R,i > 1, then A = К.) Let {a;}°2, be any sequence of positive numbers 

such that У)? a; < oo. 


(a) Show that 


Pi (xi, yi) 
P(X, Y) = ò ai 
З TTF р(х, yi) 1+ pi (хг, yi) 


is a metric on A. 
(b) Let {X,}92, = {(Xir, хәғ,..., Xnrps..-))294 be a sequence in A. Show that 


lim X, = X = ($1,85,..., 9...) 
f-—00 


if and only if 


lim xj, =X;, 12> 1. 
r—00o 


(c) Show that {X,}9, is a Cauchy sequence in (A, p) if and only if (x; )?9., isa 
Cauchy sequence in (A;, pj) for alli > 1. 


(d) Show that (A, p) is complete if and only if (A;, pi) is complete for all i > 1. 


Let C[0, оо) be the set of all real-valued functions continuous on [0, оо). For each 
nonnegative integer n, let 


If lln = max О |0 < x <n} 


and 


df — &lln 
Par Dur est 
Define 
cx od 
p(f.g) = 5 ` aa Pag). 
n-l 


(a) Show that p is a metric on C [0, оо). 


19. 
20. 


21. 


22. 


23. 


24. 
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(b) Let {f}? be a sequence of functions in C [0, оо). Show that 
lim fk = f 
k—oo 
in the sense of Definition 8.1.14 if and only if 
lim fx (x) = f(x) 
k—oo 
uniformly on every finite subinterval of [0, oo). 
(c) Show that (C [0, оо), p) is complete. 


Show that Minkowski's inequality is false if 0 < р < 1. 


Suppose that 0 « p < 1. Show that if u and v are nonnegative, then 
(и +)” <u? +v. 


Use this to show that if X, Y € R”, 


n 


p(X) = 3 xul, and pY) =} bil. 


i=l і=1 
then 

P(X + Y) < p(X) + py). 
Is p a norm on К”? 
Suppose that X = (xj j?2., is in £p, where p > 1. Show that 


(a) X € £, гайг > p; 

(b) Ifr > p, then |х|, < IXI»; 
(c) тоо [X]; = IX]. 

Let (A, p) be a metric space. 


(a) Suppose that {un} and {vn} are sequences in A, lim, ,o5 Un = и, and limy+o9 Un = 


v. Show that lim, soo Plun, Un) = plu, v). 


535 


(b) Conclude from (b) that if іт, оо un = и and v is arbitrary in A, then 


Пт, оо Plun, v) = plu, v). 


Prove: If {и}; is a Cauchy sequence in a normed vector space (A, || · ||), then 


{||ur|[}22, is bounded. 

Let 
oo 

А=+ХєК°* | the partial sums у, Xi, n > 1, are iunt ; 

i=1 

(a) Show that 

n 

Ys 


i=1 


Х| = sup 
n>1 


is anorm on A. 
(b) Let p(X, Y) = ||X — Y||. Show that (A, p) is complete. 
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25. (a) Show that 
b 
ДЕ ло) dx 


is a norm on C [a, b], 
(b) Show that the sequence { fn} defined by 


no- G 


is a Cauchy sequence in (C [a, b], || - ||). 
(c) Show that (C [a, b], || - ||) is not complete. 
26. (а) Verify that ə is a normed vector space. 
(b) Show that £55 is complete. 


27. Let A be the subset of R^? consisting of convergent sequences X = {x;}?2,. Define 
Х| = ѕир; |х|. Show that (A, || - ||) is a complete normed vector space. 


28. Let A be the subset of R” consisting of sequences X = {x;}°2, such that lim; оо x; = 
0. Define | X|| 2 max (xil | i> 1}. Show that (A, ||- ||) is a complete normed vector 
space. 

29. (a) Show that R7, is complete if p > 1. 

(b) Show that £ is complete if p > 1. 

ЗО. Show that if X = {x;}?2, € £p and Y = {y;}%, € lq, where 1/р + 1/4 = 1, 

then Z = {x;y;} € £4. 


8.2 COMPACT SETS IN A METRIC SPACE 


Throughout this section it is to be understood that (A, p) is a metric space and that the sets 
under consideration are subsets of A. 

We say that a collection # of open subsets of A is an open covering of T if T C 
U ( H | H € H }. We say that Т has the Heine—Borel property if every open covering JC 


of T contains a finite collection R such that 


r culn|n es). 


From Theorem 1.3.7, every nonempty closed and bounded subset of the real numbers 
has the Heine-Borel property. Moreover, from Exercise 1.3.21, any nonempty set of reals 
that has the Heine-Borel property is closed and bounded. Given these results, we defined 
a compact set of reals to be a closed and bounded set, and we now draw the following 
conclusion: 


A nonempty set of real numbers has the Heine—Borel property if and only if it is compact. 
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The definition of boundedness of a set of real numbers is based on the ordering of the 
real numbers: if a and b are distinct real numbers then either a < b or b < a. Since there 
is no such ordering in a general metric space, we introduce the following definition. 


Definition 8.2.1 The diameter of a nonempty subset S of A is 
d(S) = sup {o(u, v) | u,v E€ T) ; 
If d(S) < co then S is bounded. ш 


As we will see below, a closed and bounded subset of a general metric space may fail 
to have the Heine-Borel property. Since we want "compact" and “has the Heine-Borel 
property" to be synonymous in connection with a general metric space, we simply make 
the following definition. 


Definition 8.2.2 A set T is compact if it has the Heine-Borel property. 


'Theorem 8.2.3 An infinite subset T of A is compact if and only if every infinite subset 
of T has a limit point in T. 


Proof Suppose that T has an infinite subset E with no limit point in T. Then, if є T, 
there is an open set Н, such that t € Н, and Н, contains at most one member of E. Then 
#H =U {н, | te T} is an open covering of Т, but no finite collection { H} , Н,,,..., Н} 
of sets from # can cover E, since E is infinite. Therefore, no such collection can cover T; 
that is, Т is not compact. 


Now suppose that every infinite subset of T has a limit point in Т, and let #€ be an open 
covering of T. We first show that there is a sequence { Н; 72, of sets from # that covers 
T. 


If € > 0, then T can be covered by e-neighborhoods of finitely many points of T. We 
prove this by contradiction. Let t; € T. If Nc(t;) does not cover Т, there is a t2 € T such 
that p(t1,t2) > є. Now suppose that n > 2 and we have chosen fy, t2, ..., tn such that 
p(ti, tj) z e.1 <i < j € n. If U? , Ne(tj) does not cover T, there is a tj41 € T such 
that p(tj,tn41) 2 e, 1 € i € n. Therefore, p(t;,t;) > e, 1 i « j € n+ 1. Hence, 
by induction, if no finite collection of e-neighborhoods of points in T covers Т, there is an 
infinite sequence {f,}°2, in T such that p(t;,t;) > e, i A j. Such a sequence could not 
have a limit point, contrary to our assumption. 


By taking e successively equal to 1, 1/2, ..., 1/n, ..., we can now conclude that, for 
each n, there are points £15, fon, ..., tk„,n such that 
kn 


TC U Мүуп(йп). 


i=1 
Denote Bin = Ni/n(tin), 1 <i < n, n > 1, and define 


{G1, С», Сз,...} = Bits so Beaty Bin cs Bio as Вуз,..., Вкуз,...}. 
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If t € T, there is an H in J such that t є H. Since H is open, there is an є > 0 such 
that Ne(t) С H. Since t є С; for infinitely many values of j and lim; о d(G;) = 0, 


G; C M(t) CH 


for some j. Therefore, if {G;,}?2, is the subsequence of {G j} such that С у, is a subset of 
some Н; ір J (the { H;) аге not necessarily distinct), then 


тс\)н. (8.2.1) 


i=l 
We will now show that 


N 
T c(J&. (8.2.2) 
i=1 


for some integer №. If this is not so, there is an infinite sequence {f,}°°2., in T such that 


n £L) Hi. nz 1. (8.2.3) 


i=1 


From our assumption, {f,}72., has a limit f in T. From (8.2.1), Г € Hy for some k, so 
Ne(t) C Hy for some є > 0. Since іт, оо tn = f, there is an integer N such that 


n 
în € NO) C Hk C |] Hi, nk, 


i=1 
which contradicts (8.2.3). This verifies (8.2.2), so T is compact. и 


Any finite subset of a metric space obviously has the Heine-Borel property and is there- 
fore compact. Since Theorem 8.2.3 does not deal with finite sets, it is often more convenient 
to work with the following criterion for compactness, which is also applicable to finite sets. 


Theorem 8.2.4 A subset T of a metric A is compact if and only if every infinite se- 
quence {tn} of members of T has a subsequence that converges to a member of T. 


Proof Suppose that T is compact and {t,} C T. If {t,} has only finitely many distinct 
terms, there is а 7 in T such that t, = Т for infinitely many values of n; if this is so for 
ni € n? < +++, then limj+oot, = Т. If {tn} has infinitely many distinct terms, then {tn } 
has a limit point f in Т, so there are integers nı < n2 < --- such that p(t,,,0) < 1/j; 
therefore, lim; oo tn; = f. 

Conversely, suppose that every sequence in T' has a subsequence that converges to a limit 
in Т. If S is an infinite subset of T, we can choose a sequence {t,} of distinct points in 
S. By assumption, {t, } has a subsequence that converges to a member f of T. Since f isa 
limit point of {tn}, and therefore of T, T is compact. a 


Theorem 8.2.5 IfT is compact, then every Cauchy sequence {tn}°°, in T converges 
to a limit in T. 
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Proof By Theorem 8.2.4, {tn} has a subsequence (fj, } such that 


lim tn, =7 € T. (8.2.4) 


J> 


We will show that іт оо tn = f. 


Suppose that є > 0. Since {f,} is a Cauchy sequence, there is an integer № such that 
Pltn,tm) < €, n >m > N. From (8.2.4), there is апт = n; > N such that p(tm,f) < e. 
Therefore, 

Pltn, 1) < Pln, tm) + pltm.t) < 2€, n>m. 


Theorem 8.2.6 IfT is compact, then T is closed and bounded. 


Proof Suppose that 7 is a limit point of T. For each n, choose tn AT € Byjn() ПТ. 
Then limy-+oo t4 = f. Since every subsequence of {t,} also converges to 7, t € Т, by 
Theorem 8.2.3. Therefore, T is closed. 


The family of unit open balls # = {Bi (t) | te T} is an open covering of Т. Since T is 
compact, there are finitely many members t1, t2, ..., tn of T such that 5 С U^, Bilt j)- 
If u and v are arbitrary members of T, then u € B,(t,) and v € B,(t;) for some r and s in 
{1,2,...,n}, so 


plu, v) < р(и, tr) + pte. ts) + plts, v) 
<2+ plir, t) x 2 + max {p(t;,t))|1<i<j <n}. 


Therefore, T is bounded. ш 


The converse of Theorem 8.2.6 is false; for example, if A is any infinite set equipped 
with the discrete metric (Example 8.1.2.), then every subset of A is bounded and closed. 
However, if T is an infinite subset of A, then .# = {{t} | te T) is an open covering of T, 
but no finite subfamily of J£ covers Т. 


Definition 8.2.7 A set Т is totally bounded if for every є > 0 there is a finite set Te 
with the following property: ift € Т, there is an s € Te such that p(s, f) < є. We say that 
Te is a finite €-net for Т. ш 


We leave it to you (Exercise 8.2.4) to show that every totally bounded set is bounded and 
that the converse is false. 
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Theorem 8.2.8 /f T is compact, then T is totally bounded. 


Proof We will prove that if T is not totally bounded, then T is not compact. If T is not 
totally bounded, there is an € > 0 such that there is no finite e-net for T. Let t; € T. Then 
there must be a t? in T such that o(f1, t2) > є. (If not, the singleton set {t;} would be a 
finite є-пеї for T.) Now suppose that n > 2 and we have chosen t1, t2, ..., tn such that 
plti tj) > e, 1 <i < j < n. Then there must bea tj4; € T such that p(t;,tn+1) > €, 
1 x i € n. (If not, (t1, t2, ..., t4) would be a finite e-net for T.) Therefore, p(t;,t;) > є, 
1 <i <j <n+1. Hence, by induction, there is an infinite sequence {tn}; in T such 
that p(t;,t;) > €, i # j. Since such a sequence has no limit point, T is not compact, by 
Theorem 8.2.4. [| 
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Theorem 8.2.9 /f (A, p) is complete and T is closed and totally bounded, then T is 
compact. 


Proof Let S bean infinite subset of Т, and let {5; }?° | be a sequence of distinct members 
of S. We will show that {s;}°°, has a convergent subsequence. Since T is closed, the limit 
of this subsequence is in T', which implies that T' is compact, by Theorem 8.2.4. 

For п > 1, let Tjj, be a finite 1/n-net for T. Let {sjo}P2, = {s;}02,. Since T; is 
finite and (5;9)72., is infinite, there must be a member f, of Тү such that p(sio, t1) < 1 
for infinitely many values of i. Let (5/1572, be the subsequence of {s;9}?2, such that 
р(ѕп, f) < 1. 

We continue by induction. Suppose that n > 1 and we have chosen an infinite subse- 
quence (5j,—13;54 Of {Sin—2}P2,. Since Туһ is finite and {5—1} is infinite, there 
must be member f, of Туу, such that p(sjn-1,t) < 1 /n for infinitely many values of 
i. Let {8jn}P2, be the subsequence of {5;,,-1}02, such that p(sin,t) < 1/n. From the 
triangle inequality, 

D(sin.sj) €2/n, i,jzl, nzl. (8.2.5) 


Now let 5; = si, i > 1. Then ($; ed is an infinite sequence of members of T. Mo- 
roever, if i, j > n, then’s; and $; are both included in {Sin}P2,, SO (8.2.5) implies that 
PiS) < 2/n; that is, {5;}?2, is a Cauchy sequence and therefore has a limit, since 


(A, p) is complete. " 


Example 8.2.1 Let T be the subset of £55 such that |x;| < i, i > 1, where limi оо Mi 
0. Show that T is compact. 


Solution We will show that T is totally bounded in £;5. Since fo is complete (Exer- 
cise 8.1.26), Theorem 8.2.9 will then imply that T is compact. 


Let € > 0. Choose N so that ш; < € ifi > N. Let y = max {ui | l<i< п} and let р 
be an integer such that pe > u. Let Qc = {rie | rj = integer in[—p, pi}. Then the subset 
of Ёоо such that x; € Qe, 1 <i € N, and x; = 0, > N, isa finite e-net for Т. 


Compact Subsets of Са, b] 


In Example 8.1.7 we showed that C [a, b] is a complete metric space under the metric 


eC. g) = If — gl = max {| f(x) - gœ) |a <x <b}. 
We will now give necessary and sufficient conditions for a subset of C [a, b] to be compact. 
Definition 8.2.10 A subset T of C [a, b] is uniformly bounded if there is a constant M 


such that 
Мо) M if a<x<b and fer. (8.2.6) 


A subset Т of C [a, b] is equicontinuous if for each є > 0 there is a д > 0 such that 


fx) — fæl <e if х,о € [a,b], |x1—x2| <6, and f eT. (8.2.7) 
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Theorem 2.2.8 implies that for each f in C [a, b] there is a constant M y which depends 
on f , such that 
|fG) SM; if azxzb, 


and Theorem 2.2.12 implies that there is a constant 6 y which depends on f and є such that 
|f(x1) — f(x2) e if х, хә € [a,b] аа |x1— x2| < dy. 
The difference in Definition 8.2.11 is that the same M and 6 apply to all f in Т. 


Theorem 8.2.11 A nonempty subset T of C [a, b] is compact if and only if it is closed, 
uniformly bounded, and equicontinuous. 


Proof For necessity, suppose that T is compact. Then T is closed (Theorem 8.2.6) 

and totally bounded (Theorem 8.2.8). Therefore, if є > 0, there is a finite subset T; = 

{g1, 22..... Zk} of Cla, b] such thatif f € Т, then || /—gi|| < € for some i in {1,2,..., k}. 
If we temporarily let e — 1, this implies that 


ПАП = CF — e) ell S fF — 21+ legil s< 1+ ail. 
which implies (8.2.6) with 


M = 1+ max {|gil||1 <i x kj. 


For (8.2.7), we again let € be arbitary, and write 


| f (x1) — FEDI < Lf 69) — 811) + [gi 1) — gi] + 1g; 692) — f(2)] 
€ |gi (v1) — 8102) + 211 f — gill (8.2.8) 
< |gi (x1) — gi (x2)| + 2e. 


Since each of the finitely many functions gi, g2, ..., gx is uniformly continuous on [a, b] 
(Theorem 2.2.12), there is a ó > O such that 


lg) — gii] «e if |xy—x2] «8, 1xizxk. 


This and (8.2.8) imply (8.2.7) with є replaced by 3e. Since this replacement is of no 
consequence, this proves necessity. 


For sufficiency, we will show that T is totally bounded. Since Т is closed by assumption 
and C [a, b] is complete, Theorem 8.2.9 will then imply that T is compact. 


Let m and n be positive integers and let 


Я 
& =a+—(b-a), O<r<m, and р = —, -n<s<n; 
m n 


that is, а = & < ё < -+ < & = b is a partition of [a, b] into subintervals of length 
(b — a)/m, and —M = ney < Nenti € +++ € Nn-1 < Nn = M is a partition of the 
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segment of the y-axis between y — —M and y — M into subsegments of length M/n. 
Let Smn be the subset of C [a, b] consisting of functions g such that 


{g(&o), g(é1), oe) g(Em)} C {n-n; N—n+1 28) Tn—1: Nn} 
and g is linear on [£; 1, £j], 1 <i < m. Since there are only (m + 1)(2n + 1) points of the 
form (ér, ns), Smn is a finite subset of C [a, b]. 


Now suppose that € > 0, and choose 6 > 0 to satisfy (8.2.7). Choose m and n so that 
(b — a)/m < б and 2M/n < e. If f is an arbitrary member of Т, there is a g in Smn such 
that 


lg(&)) - f(&)| «e, O<i<m. (8.2.9) 


If0xi -m-1, 


(gi) — &(&+1)| = lei) — FED 41S GD) — f Gil + | fF Gi) — &(@+1)|. (8.2.10) 
Since & 41 — & < ô, (8.2.7), (8.2.9), and (8.2.10) imply that 


Igi) = &(@:+1)| < 3e. 


Therefore, 
lge&) —g(x)| «3e, & €x ё, (8.2.11) 
since g is linear on [£;, £j 1]. 


Now let x be an arbitrary point in [a, b], and choose i so that x € [£;, & 41]. Then 


If) — 260] € 170) — FED + FE) — (8) + 1g Gi) — go), 


so (8.2.7), (8.2.9), and (8.2.11) imply that | f(x) — g(x)| < 5e,a < x < b. Therefore, Sinn 
is a finite 5e-net for Т, so T is totally bounded. ш 


Theorem 8.2.12 (Ascoli-Arzela Theorem) Suppose that F їз an infinite uni- 
formly bounded and equicontinuous family of functions on |a, b]. Then there is a sequence 
{fn} in F that converges uniformly to a continuous function on |a, b]. 


Proof Let T be the closure of F; that is, f € T if and only if either f € T or f 
is the uniform limit of a sequence of members of F. Then Т is also uniformly bounded 
and equicontinuous (verify), and T is closed. Hence, T is compact, by Theorem 8.2.12. 
Therefore, F has a limit point in T. (In this context, the limit point is a function f in 
T.) Since f is a limit point of 27, there is for each integer n a function fn in F such that 
ll. fn — f || < 1/n; that is {fn} converges uniformly to f on [а, b]. a 


8.2 Exercises 


1. Suppose that Ti, T2, ..., Ty are compact sets in a metric space (А, p). Show that 
Uk T; is compact. 
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2. 


10. 


11. 


(a) Show that a closed subset of a compact set is compact. 

(b) Suppose that 7 is any collection of closed subsets of a metric space (А, р), 
and some T in 7 is compact. Show that N (T | Тє 7) is compact. 

(c) Show that if 7 is a collection of compact subsets of a metric space (А, p), 
then N {T | Тє 7) is compact. 


If S and Т are nonempty subsets of a metric space (A, p), we define the distance 
from S to T by 
dist(S, T) = inf(p(s.?) |se S,t ET}. 

Show that if S and T are compact, then dist(S, T) = p(s,t) for some s in S and 
some f in Т. 

(a) Show that every totally bounded set is bounded. 

(b) Let 
Boo 1 ifi =r, 

"^ )0 ifi Ær, 


and let T be the subset of læ consisting of the sequences X, = {6;r}92), 
r > 1. Show that Т is bounded, but not totally bounded. 


Let T be a compact subset of a metric space (A, p). Show that there are members 5 
and Т of T such that d(s, 1) = d(T). 


Let T be the subset of £4 such that |x;| € ji, i > 1, where bur Hi < оо. Show 
that T is compact. 


Let T be the subset of £? such that |x;| < ш, i > 1, where У)? u? < oo. Show 
that T is compact. 


Let S be a nonempty subset of a metric space (А, р) and let ио be an arbitrary 
member of A. Show that S is bounded if and only if D — {р(и, ио) | UE 5} is 
bounded. 


Let (A, p) be a metric space. 


(a) Prove: If S is a bounded subset of A, then S (closure of S) is bounded. Find 
d(S). 

(b) Prove: If every bounded closed subset of A is compact, then (A, p) is com- 
plete. 


Let (A, p) be the metric space defined in Exercise 8.1.16 Let 
T= Ti x Ta x--- X Tk, 


where T; C Aj and T; Z 0,1 <i < k. Show that T is compact if and only T; is 
compact for 1 <i < k. 


Let (A, p) be the metric space defined in Exercise 8.1.17. Let 


T=T, XT. X+++X Ty хе, 
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where T; C A; and Т; # 0, i > 1. Show that if T is compact, then T; is compact 
for all i > 1. 


12. Let {7,}92, bea sequence of nonempty closed sets of a metric space such that (a) 
T; is compact; (b) T441 C Th, n > 1; and (c) lim, оо d(Tn) = 0. Show that 
150, Tn contains exactly one member. 


8.3 CONTINUOUS FUNCTIONS ON METRIC SPACES 


In Chapter we studied real-valued functions defined on subsets of R”, and in Chapter 6.4. 
we studied functions defined on subsets of R” with values in R”. These are examples of 
functions defined on one metric space with values in another metric space.(Of course, the 
two spaces are the same if n — m.) 


In this section we briefly consider functions defined on subsets of a metric space (A, p) 
with values in a metric space (B, с). We indicate that f is such a function by writing 


f : (A, p) > (В, о). 
The domain and range of f are the sets 
Юу = {и eA | f (и) is defined) 
and 
Ry = lv є В | v = f(u) for some u in Df}. 

Definition 8.3.1 We say that 

lim f(u) = v 

uu 
iff є Dy and for each є > 0 there is ad > 0 such that 


c(f(u)v)«e if иєр; and O0<p(u,u) <6. (8.3.1) 


Definition 8.3.2 We say that f is continuous at Ù if i € D y and for each є > 0 there 
isa ô > 0 such that 


o(f(u), /@)) «e if we Ds Ns(u). (8.3.2) 
If f is continuous at every point of a set S, then f is continuous on S. ш 


Note that (8.3.2) can be written as 
SDF п %@)) C Ne(f@)). 


Also, f is automatically continuous at every isolated point of D y. (Why?) 
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Example 8.3.1 If (A, ||- ||) is a normed vector space, then Theorem 8.3.5 implies that 
f (и) = |[u|| is a continuous function from (A, р) to R, since 
ШЕЕ 


Here we are applying Definition 8.3.2 with р(и, ù) = ||u — | and o (v, v) = |v — v]. 


Theorem 8.3.3 Suppose thatti € D у. Then 


lim f(u) =v (8.3.3) 
if and only if 
im fn) =? (8.3.4) 


for every sequence {иһ} in D y such that 


lim un =Й. (8.3.5) 


Proof Suppose that (8.3.3) is true, and let {un} be a sequence in D у that satisfies 
(8.3.5). Let € > 0 and choose ô > 0 to satisfy (8.3.1). From (8.3.5), there is an inte- 
ger N such that р(и,, ù) < à if n > N. Therefore, o(f(u4), v) < eif n > N, which 
implies (8.3.4). 


For the converse, suppose that (8.3.3) is false. Then there is an єо > 0 and a sequence 
{un} in D у such that p(un, 4) < 1/n and o (f (un), 0) > €o, so (8.3.4) is false. ш 


We leave the proof of the next two theorems to you. 


Theorem 8.3.4 A function f is continuous at ii if and only if 


lim f(u) = f@). 


Theorem 8.3.5 A function f is continuous at ii if and only if 
lim f(un) = f@) 
n—oo 
whenever {un} is a sequence in D y that converges to ii. 
Theorem 8.3.6 If f is continuous on a compact set T, then f (T) is compact. 


Proof Letív,) bean infinite sequence in f(T). For each n, v, = f (иһ) for some un € 
T. Since T is compact, {un} has a subsequence {un} such that іту ои, = ù € T 
(Theorem 8.2.4). From Theorem 8.3.5, іт; оо f(Un;) = ГО); that is, limj—oo Un; = 
f(u). Therefore, f(T) is compact, again by Theorem 8.2.4. ш 


Definition 8.3.7 A function f is uniformly continuous on a subset S of D у if for each 
€ > 0 there is a ô > 0 such that 


c(f(u) f(v) «e whenever p(u,v)<6 and uw,ve S. 
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Theorem 8.3.8 If f is continuous on a compact set T, then f is uniformly continuous 
on T. 


Proof If f is not uniformly continuous on Т, then for some eo > 0 there are sequences 
{un} and {va} in T such that p(un, Un) < 1/n and 


O (f (un). f(vn)) = «о. (8.3.6) 


Since T is compact, {un} has a subsequence (u;, } that converges to a limit # in Т (Theo- 
rem 8.2.4). Since p(us, , vn, ) < 1/nx, liMk—>oo Un, = ii also. Then 


lim f Ung) = lim f (nj) = fü) 
k—oo k—oo 
(Theorem 8.3.5), which contradicts (8.3.6). ш 


Definition 8.3.9 If f : (А, р) > (A, p) is defined on all of A and there is a constant a 
in (0, 1) such that 


p(f u), f(v) < ар(и, v) forall (и, о) є Ax A, (8.3.7) 


then f is a contraction of (A, p). a 
We note that a contraction of (A, p) is uniformly continuous on A. 


Theorem 8.3.10 (Contraction Mapping Theorem) /f f is a contraction 


of a complete metric space (A, p), then the equation 
f(u)-u (8.3.8) 


has a unique solution. 


Proof То see that (8.3.8) cannot have more than one solution, suppose that м = f(u) 
and v — f(v). Then 


plu, v) = pCf (u), fv). (8.3.9) 


However, (8.3.7) implies that 
pCf u), f(v)) < api, v). (8.3.10) 
Since (8.3.9) and (8.3.10) imply that 
plu, v) < ор(и, v) 


and о < 1, it follows that p(u, v) = 0. Hence и = v. 
We will now show that (8.3.8) has a solution. With uo arbitrary, define 


Un = f(Un-1), n>. (8.3.11) 
We will show that {un } converges. From (8.3.7) and (8.3.11), 


pni un) = pCfQun), f(Un-1)) < &p(Un, un-1). (8.3.12) 
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The inequality 
PUn+1,Un) € &”p(u1, мо), n=O, (8.3.13) 
follows by induction from (8.3.12). If n > m, repeated application of the triangle inequality 
yields 
Dun, Um) < PUn,Un—1) + P(Un-1, Un—2) t +++ + р(ит+1, Um), 
and (8.3.13) yields 
о" 


pun, Um) < pti, моја" (1 at b a T) < ——, 


Now it follows that 


p41, Mo) у 


1 if n,m >N, 


pun, ит) < 


and, since limy+o. & = 0, {un} is a Cauchy sequence. Since A is complete, {un} has a 
limit V. Since f is continuous at Ti, 


f@) = lim f(un-1) = lim un = ii, 
n—oo поо 
where Theorem 8.3.5 implies the first equality and (8.3.11) implies the second. ш 
Example 8.3.2 Suppose that Л = h(x) is continuous on [a, b], К = K(x, y) is con- 


tinuous on [a,b] x [a,b], and |K(x, y)| € M ifa < x,y < b. Show that if |A| < 
1/M(b — a) there is a unique u in C [a, b] such that 


b 
u(x) = h(x) + af K(x, у)и(у) ау, a<x<b. (8.3.14) 


(This is Fredholm’s integral equation.) 


Solution Let A be C[a, b], which is complete. If u € C[a, b], let f(u) = v, where 


b 
v(x) = h(x) + af K(x, y)u(y)dy, a<x<b. 


Since v € C[a, b], f : Cla, b] > C[a, b]. If u1, u2 € C [a, D], then 


b 
ln (к) — vax) < af £x, ЎЫ G) — 109 ay, 


so 
10 = val] < |AIM (b — a)|u: — ual]. 


Since |A|M(b — a) < 1, f is a contraction. Hence, there is a unique u in C [a, b] such that 
/ (и) = u. This u satisfies (8.3.14). 
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8.3 Exercises 


Suppose that f : (A, p) — (B,o) and Df = A. Show that the following state- 

ments are equivalent. 

(a) f is continuous on A. 

(b) If V is any open set in (В, о), then f^! (V) is open in (A, р). 

(c) IfV is any closed set in (B, с), then f^! (V) is closed in (A, p). 

A metric space (А, p) is connected if A cannot be written as A = A, U А2, where 

A, and А» are nonempty disjoint open sets. Suppose that (A, p) is connected and 

f : (A. p) > (В, о), where Dy = A, Ry = В, апа f is continuous on A. Show 

that (B, о) is connected. 

Let f bea continuous real-valued function on a compact subset S of a metric space 

(A, p). Let o be the usual metric on R; that is, o (x, y) = |x — y|. 

(a) Show that f is bounded on S. 

(b) Leta = infyes f(u) and В = sup,eg f(u). Show that there are points м1 
and иг in [а,Ь] such that f (u1) = a and f(u2) = В. 


Let f : (A, р) — (В, с) be continuous on a subset U of A. Let W be in U and 
define the real-valued function g : (A, р) > R by 


glu) = o(f(u), f@), we. 


a) Show that g is continuous on U. 
8 
(b) Show that if U is compact, then g is uniformly continuous on U. 


(c) Show that if U is compact, then there isa ù € U such that g(u) < g(i), 
u eU. 


Suppose that (A, о), (B, c), and (C, y) are metric spaces, and let 

f:(A,p) > (В,о) and g:(B,o) — (С, у), 
where Dy = A, Ry = D, = В, and f and g are continuous. Define h : (А, p) > 
(C, y) by h(u) = g(f(u)). Show that Л is continuous on A. 


Let (A, p) be the set of all bounded real-valued functions on a nonempty set S, 
with o(u,v) = ире |u(s) — v(s)|. Let 51, 52, ..., sy be members of S, and 
f(u) = g(u(s1), u(s2), .... u(sy)), where g is real-valued and continuous on IR^. 
Show that f is a continuous function from (A, p) to R. 

Let (A, p) be the set of all bounded real-valued functions on a nonempty set S, 
with p(u,v) = sup,es |u(s) — v(s)]. Show that f(u) = inf;es u(s) and g(u) = 
Sup,cs U(S) are uniformly continuous functions from (А, p) to R. 


Let 7 [a, b] be the set of all real-valued functions that are Riemann integrable on 


b 
[а, b], with р(и, v) = sup; 2,25 |u(x) — v(x)|. Show that f(u) = Í и(х) ах isa 


uniformly continuous function from J [a, b] to К. 
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Answers to Selected 
Exercises 


Section 1.1 pp. 9—10 


1.1.1 (p. 9) (a) 2max(a,b) (b)2min(a,b) (c)4max(a,b,c) (d) 4 тіп(а, Р, с) 
1.1.5 (р. 9) (a) oo (по); —1 (yes) (b) 3 (no);—3 (по) (с) V7 (yes); —V7 (yes) 
(а) 2 (по); —3 (по) (e) 1 (по); –1 (по) (f) V7 (по); —V7 (no) 


Section 1.2 pp. 15-19 


1.2.9 (p. 16) (а) 27/2n)! (Ь) 2:3"/(2п+1)! (c)2"Qmn/(n)? (d)n'/n! 


1.2.10 (p. 16) (b) по 1.2.11 (p. 16) (b) no 


a Tl 


j=1 


1.221 (p. 18) },(х1,х2,..., Xn) = 27-5 тах(хү,хә,..., Xn), £n X1. X2, ..., Xn) = 
2^-! min(x1, X2, ..., Xn) 


Section 1.3 pp. 27—29 


1.3.1 (p. 27) (a) [3. 1); (00, >) U[IL, оо); (—00, OJU (3. оо); (0, 2]; (—00, 0]U (3, оо); 
(оо, $] U [1, œ) (b) (—3, 2) U (2, 3); (оо, —3] U [-2, 2] U [3, оо); Ø; (700,00); 0; 
(—oo, —3] U [-2, 2] U [3, оо) (c) 0; (—00, оо); Ø; (—00, оо); 0; (—00, оо) 

(d) 9; (оо, оо); [-1, 1]; (оо, —1) U (1, оо); [-1, 1]; (—оо, оо) 

1.3.2 (р. 27) (a) (0.3] (b)[0.2] (c) (00,1) О (2,00) (d) (—00, 0] U (3, оо) 
134(p.27)(a)i (b); (c)6 (d)1 
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1.3.5 (p. 27) (a) neither; (—1,2) U (3, оо); (Coo, -1) U (2,3); (Coo, -1] U (2,3); 
(—oo, —1] U [2,3] (b) open; S; (1, 2); [1, 2] (c) closed; (—3, —2) U (7,8); (оо, -3) U 
(72, 7) U(8, оо); (-oo—3] U[-2, 7] U[8, оо) (d) closed; Ø; U {(n,n + 1) | n = integer}; 
(—oo, оо) 

13.20 (p. 28) (а) {х |х =1/n,n=1,2,...}; (b) Ø (c), (d) Si = rationals, 
$5 = irrationals (e) any set whose supremum is an isolated point of the set (f), (g) the 
rationals (h) S; = rationals, $5 = irrationals 


Section 2.1 pp. 48—53 


212 (p. 48) Dp = [-2,1) U yoo), Dg = (oc, -3| U [3, D) U (оо), Dra, = 
Dye = [3,7) U (7,00), Руз = (3,4) U (4, 7) U (7, o0) 

213 (p. 48) (a), (b) (x |х z (2k + 1)z/2 where k = integer} (c) (x |х 40,1} 
(d) {x|x 40} (e) 1. оо) 

2.1.4 (p. 49) (a) 4 (b) 12 (c)-1 (d)2 (e)-2 

216 (р. 49)(a) $ (b)- (i (d) 

2.1.7 (p. 49) (a) 0.2. (Ь) 0, попе (c)-i.i (d) none, 0 

2.1.15 (p. 50) (а) 0 (b)O (с) попе (d)O (e)none(f)O 

2.1.18 (p. 50) (a)O (b)O (с) попе (d)none (е) попе (#) 0 

2.1.20 (р. 50) (а) оо (Ь) -оо (с) о (4) о (е) оо (#) –оо 

2.1.22 (р. 51) (а) попе (Ь) оо (с) оо (d) попе 

2.1.24 (р. 51) (а) оо (Б) оо (с) о (4) –оо (е) попе (f) оо 

2.1.31 (р. 52) (а) 2 (b) (с) о (4) –оо (е) оо (#) 2 

2.1.32 (р. 52) limyoor(x) = oo ifn > m and an/bm > 0; = —oo if n > m and 
an/bm < 0; = an/bm if n = m; = Q ifn < m. о-оо r(x) = (—1)” 7” lim, оо r (x) 
2.1.33 (p. B2) lim,s;, f(x) = lim, g(x) 

2.1.37 (p. 52) (c) lim, (f —g)(x) < бахо f(x)-lim, >x- g(x); lim, ,,, (f— 
g)(x) > lim, _ /(х) — Шах хо g(x) 


Section 2.2 pp. 69-73 


2.2.3 (p. 69) (a) from the right (b) continuous (с) none (d) continuous (е) 
none (f) continuous (g) from the left 

2.24 (p. 69) [0,1), (0,1), [1,2), (1,2), 1,2], 1,2] 2.2.5 (р. 69) [0, D), (0,1), 
(1, оо) 2.2.13 (p. 70) (b) tanh x is continuous for all х, coth x for all x 4 0 
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2.2.16 (p. 70) No 2.2.21 (p. 71) (а) [-1. 1], [0, оо) (b) U2- Qn. (2п+1)л), 
(0, оо) (c) Us. SS (nm, (n + 1)л), (—00, 21) U (71, D) U (1, œ) (d) Ur. Vu [nz (n + 
3)7], [0, оо) 

2.2.23 (p. 71) (а)(—1,1) (Б) (оо, оо) (с) хо A (2k +40), К =integer (d) 
х # 2 (е) х #1 (Е) х + (К+ 2л), К =integer (6) х A (k+ 1л), k = 
integer (ph) x #0 (1) x #0 


Section 2.3 pp. 84—88 


2.3.4 (p. 85) (b) p(c) = q(c) and p! (c) = q} (c) 

2.3.5 (p. 85) f(x) = n(n-1)---(n-k-1)x"-*-!|x|ifl < k < n-1; f(x) = п! 
ifx 0; (х) = —nlifx < 0; f(x) = Oif > n and x 4 0; f (0) does not 
exist if k > n. 

2.3.7 (p. 85) (a) с = ac — bs, 5 = bcc as. (b) с(х) = е cosbx, s(x) = 
ех sin bx 

2.3.15 (p. 86) (b) f(x) = –1 if x < 0, f(x) = 1 if x > 0; then f’(0+) = 0, but 
f1.(0) does not exist. (c) continuous from the right 

2.3.22 (p. 87) There is no such function (Theorem 2.3.9). 

2.3.24 (p. 87) Counterexample: Let xo = 0, f(x) = |x|?/? sin(1/x) if x 4 0, and 
f(0) =0. 

2.3.27 (p. 88) Counterexample: Let xo = 0, f(x) = x/|x| if x z 0, f(0) = 0. 


Section 2.4 pp. 96—98 


2.4.2 (p. 96)1 243 (р. 96)» 244(p.96)oo 2.45 (р. 96) (-1)""!n 
24.6 (p. 96)1 2.4.7 (р. 96)0 24:8 (р. 96)1 249 (р. 96)0 


2.410 (p. 96)0 2.411 (p. 96)0 2412 (p. 96) —-oo 24.13 (p. 96) 0 
2414 (p. 96) 1 2415 (p. 96)0 2.4.16 (p. 96)0 2.4.17 (p. 96) 1 
2.4.18 (p. 96)1 2.419 (p. 96)1 2420 (р. 96)e 2.4.21 (p. 96) 1 
2.4.24 (p. 96) 1/е 2422 (р. 96)0 


2.4.23 (р. 96) —œ if a < 0,0ifo >0 

2425 (p. 96) e? 2426 (p. 96)1 2427 (p. 96)0 2.4.28 (р. 96) 0 
2.4.29 (p. 96) œ ifa > 0, —oo ifo < 0 

24.30 (p. 96) оо 2.4.31 (p. 97) 1. 24.32 (p. 97) 1/1202.4.33 (p. 97) oo 
24.34 (p. 97) —oo 2.4.35 (p. 97) —oo ifa <0, 0ifa > 0 

2.4.36 (p. 97) оо 24.37 (p. 97) 1. 24.38 (p. 97) 0. 2.4.39 (p. 97) 0 
2.4.40 (p. 97)0 2.4.41 (p. 97) (b) Suppose that g' is continuous at xo and f(x) = 
g(x) if x € xo, f(x) = 1 + g(x) if x > xo. 

2444 (p. 97) (a) 1 (b)e (c)1 2445 (р. 98)e- 


Answers to Selected Exercises 553 


Section 2.5 pp. 107—112 


2.5.2 (р. 107) f@* (xo)/(n -- 1)!. 2.5.4 (p. 107) (b) Counterexample: Let хо = 0 
and f(x) = x|x|. 
2.5.5 (р. 108) (b) Let g(x) = 1 + |x — xo, so f(x) = (x — xo)(1 + |x — xol). 
2.5.6 (р. 108) (b) Let g(x) = 1 + |x — xol, so f(x) = (x — xo? (1 + |x — xol). 
2.510 (p. 109) (b) (i) 1,2,2,0 (ii) 0, –л, 37/2, —4 + л3/2 

(iii) —x2/4,—2z,—6 + n?/4,4n (iv) —2, 5, 16,65 
2.5.11 (p. 109) (b) 0, —1, 0, 5 
2.5.12 (p. 110) (b) (i) 0,1,0,5 (ii) -1, 0, 6, —4 (iii) V2, 342, 1142, 
57/2 (iv) —1, 3, —14, 88 (a) min (b) neither (c) min (d) тах (e) 
min (f) neither (е) min (h) min 
2.514 (p. 110) f(x) = е2 if x £0, f(0) = 0 (Exercise 2.5.1 (p. 107)) 
2.5.15 (p. 111) None if b? — 4c < 0; local min at xı = (—b + Vb? — 4c)/2 and local 
max at x = (—b — Vb? — 4c)/2 if b? — 4c > 0; if b? = 4c then x = —b/2 is a critical 
point, but not a local extreme point. 


2516 (p. 111) (s) c (Z) FOO Te 

2.5.20 (p. 112) (a) M3h/3, where Мз = supi, а= Lf 9 (c)] 
(b) M4I? /12 where Mg = supy, «2; If OOl 

2.5.21 (p. 112) k = —A/2 


Section 3.1 pp. 125-128 


3.1.8 (p. 126) (b) monotonic functions (c) Let [a, 5] 
f(0) = fA) = 1 and f(x) = x if0 < x < 1. Then s(P) 
is a Riemann sum of f over P. 


3.19 (p. 127) (а) 4,—4 (b) 4,1 3.1.10 (p.127)e^—e" 3.1.11 (p. 127) 
1—cosb 3.1.12 (p. 127) зїп b 


3.1.14 (р. 127) f(@[gi — &(а)] + f(d)(22 — 81) + FOL) — &2] 
3.1.15 (p. 127) f@lgi — (a)] + FOO) — gp] + У f (am) (Emi — £m) 
3.1.16 (p. 127) (a) If = 1 and f is arbitrary, then f f(x) dg(x) = 0. 


[0, 1] and P = {0,1}. Let 
0 and S(P) = 1, but neither 


Section 3.3 pp. 149—151 
3.3.7 (p. 150) (а)п=с=2 (b)ū=c=0 (c)u-(e-2)/(e—1, c 2 мт 
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Section 3.4 pp. 165—171 


3.4.4 (p. 166) 
(a) (1) р>2 (ii) p>0 (iii) 0 
(b (i)p=2 (i) p>0 (o 
(c) (1) попе (ii) p>0 (iii) 1/p 


(2 40259 00-27 ш (2) 

(e) (1) попе (ii) none 
3.4.5 (p. 166) (a)n! (b) 3 (c)diveget (d)! (e)-1 (f)0 
3.4.8 (p. 166) (a) divergent (b) convergent (c) divergent (d) convergent (е) 
convergent (f) divergent 
349 (p. 166) (a) p<2 (b)p«1 (c)p»-1 (d)-1« p <2(e) none 
(f)noe (6) p<1 
3411 (p. 167) (a) p-q«1 (b)pq«1 (c)-l<p<2q-1(d)q>-1, 
ptq>1 (e)ptaq>1 (f)¢4+1<p<3qt+!1 
3.4.12 (p. 167) deg g — deg f > 2 
34.18 (p. 168) 


(a) (i) p>1 (ii) Oc pz 
(b) (i) p>1 (ii) p <1 
(c) (i)p>1 (ii)0< pl 
(d) (i) p>0 (ii) none 
(e) (i)l<p<4 (ii)0<p<1 
(f) (i) p>3 (0) 0<р= 3 


3.4.25 (р. 169) 

(а) (pi ()-2«ps-i 
(b) ()p»-1 (ii) none 

(c) (i) р<-1 (ii) none 

(d) (i) none (ii) none 

Or Opes Wet 


Section 4.1 pp. 192—195 


413 (р. 192) (a)2 (b)! (c)0 414 (р. 192)(a)1/2 (b)1/2 (c) 
1/2 (d)1/2 

41.11 (p. 192) (d) JA 4114 (p. 193) (a) 1. (b)1 (с) 1 (4) –оо 
(e) 0 

4.1.22 (p. 193) If 5, = 1 and t, = —1/n, then (lim, soo 55)/ (lim; оо tn) = 1/0 = oo, 
but limy—+oo Sn/tn = —oo. 

4.1.24 (p. 193) (a) оо,0 (Б) оо, –оо if |r| > 1; 2, -2 ifr = —1;0,0ifr = 1; 1, 
-lif|r|<1 (c) oo, —oo ifr <-1;0, 0if |r| < 1; 2, 4ifr =1;00, ooifr>1 


(9) оо, оо (е) ||, –/4 
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4125 (p. 194) (а) 1,-1 (Ь) 2,-2 (c)3,-1 (c) V3/2,-V3/2 


4.1.34 (p. 194) (b) If {sn} = (1,0, 1,0,...}, then limp+oo = 


Section 4.2 pp. 199—200 


4.2.2 (p. 199) (a) limm—+oo Sam = oo, lima зоо 52т+1 = —00 
b) limm—oo S4m = 1,limg oo 54т+2 = —1, limm—oo 52,41 = 0 
(c) liMm—>oo $2т = 0, limg soo Sam+1 = 1, Шот оо S4m4+3 = —1 


(d) limp 5554 = 0 (е) liMmm>oo S2m = ОО, Пил аа S2m+1 = 0 
(£) litt, оо Sem = lity so 5вт+2 = 1, liMm>oo 5вт+1 = V2, 
limn—>oo S8m+3 = liMm>oo Sam+7 = 0, limp soo Semis = —V2, 
lim. oo Sgm+4 = lim; .oo Sgm+6 = —1 
4.2.3 (р. 199) {1,2,1,2,3,1,2,3,4,1,2,3,4,5,...} 
4.2.8 (p. 200) Let {tn} be any convergent sequence and {sn} = (t1, 1, 12,2, ... tg, n, ...)- 


Section 4.3 pp. 228-234 


4.3.4 (p. 229) (b) No; consider $^ 1/n 

4.3.8 (p. 229) (a) convergent (b) convergent (c) divergent (d) divergent 

(e) convergent (f) convergent (g) divergent (h) convergent 

4.3.10 (p. 229) (a) p» 1 (b)p»1 (c)p»1 

4.3.15 (p. 230) (a) convergent (b) convergent if 0 <r < 1, divergent ifr > 1 

(c) divergent (d) convergent (e) divergent (f) convergent 

4.3.17 (p. 231) (a) convergent (b) convergent (c) convergent (d) convergent 
4.3.18 (p. 231) (a) divergent (b) convergent if and only if 0 < r < 1 orr = 1 and 
p < —1 (с) convergent (d) convergent (e) convergent 

4.3.19 (p. 231) (a) divergent (b) convergent (c) convergent (d) convergent if 
o < B —1, divergent ifo > 8—1 

4.3.20 (p. 231) (a) divergent (b) convergent (c) convergent (d) convergent 


4.3.21 (p. 231) (a) DCD” (b) Eco | + 1 | 


п nlogn 
(c) XED"? (d) ZED” 
4.3.27 (p. 232) (a) conditionally convergent (b) conditionally convergent (c) abso- 
lutely convergent (d) absolutely convergent 


4.3.28 (p. 232) Let k and s be the degrees of the numerator and denominator, respec- 
tively. If |r| = 1, the series converges absolutely if and only if s > k + 2. The series 
converges conditionally if s = k + 1 and r = —1, and diverges in all other cases, where 
s>k-+land |r| = 1. 


4.3.30 (p. 232) (b) У`(—1)”//п 4.3.41 (p. 233) (а)0 (b) 24 — ao 
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Section 4.4 pp. 253-256 


441 (p. 253) (a) Fx) 20, |x| x1 (b) F(x) = 0, |x| x 1 

(c) F(x) 20, -1«x x1 (d) F(x) = sinx, —oo <x < coo 

(e) Fx) 21, -1«xxLF(x)20,|x| »1 (£) F(x) =x, -co«x«oo 

(g) F(x) = х2/2, -oo « x «oo (h) F(x) = 0, -oo «x < oo 

(i) F(x) = 1, =œ < x < co 

44.5 (p. 254) (a) Fx) 20 (b) F(x) = 1, |x| < 1; Fx) = 0, |x| > 1 

(c) F(x) = sinx/x 

44.6 (p. 254) (c) Е„(х) = х"; Se = [-k/(k + D, k/(k + DI 

4.4.7 (p. 254) (а) [- 1, 1] (D) [-r r]U (ju (2-1, 0 < r < 1 (c) [-r.r]U {1}, 0 < 

r«i 

(а) [r,r], r>0 (e) (-oo.-1/r]U[-r.r]U[1/r, oo) U (1, O«r « 1 

(£) [r,r], r» 0 (g)[-nr.r»0 (h)(Coo.-rJU[r.oo)U {0}, r > 0 

(1) [r,r], r» 0 

4.4.12 (p. 254) (b) Let S = (0, 1], F (x) = sin(x/n), С„(х) = 1/x?; then F = 0, 

G = 1/x?, and the convergence is uniform, but || 5,6, || = oo. 

4414 (р. 255)(a)3 (b)! (c)4 (d)e-1 

44.17 (p. 255) (a) compact subsets of (—$,00) (b) [- 1.09) (c) closed sub- 

1—45 1-4 У5 
2 "' 2 


sets of 


(а) (оо, со) (e) [r.oo). r > 1 (f) compact subsets 


of (—oo, 0) U (0, co) 
4.4.19 (p. 255) (a) Let S = (—00, оо), fa = an (constant), where Y` an converges 
conditionally, and gn = |an|. (b) "absolutely" 


4.4.20 (p. 255) (a) (i) means that Y; | f, (x)| converges pointwise and У) f, (x) con- 
verges uniformly on S, while (ii) means that У | f, e) converges uniformly on S. 


44.27 (p. 256) (a) co (b) Ус p 


х2"+1 


т + 1) (2n + 1)(2n + 1)! 


Section 4.5 pp. 275—280 


4.5.2 (р. 276) (a) 1/3е (b)1 (c) (d)! (е) 
458 (р. 276) (а)1 (b)i (c)! (d)4 (е) 1/е (f)! 
4.5.10 (p. 277) x(1+x)/(1—x)? 4.5.12 (p. 277) e=” 


oo («5 " 
4.5.16 (p. 277) таб —1)";R=1 
4.5.17 (p. 277) Tan ! x = Y (-1)" 


n=0 


a +1)” ; FOP) = 0; у®"+(0у = (-D* 0л); 
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л 1 ы (-1) 
L = Tan! = -— À—À— 
6 an J3 25 Qn + 1)3"+1/2 


n=0 


oo oo 
х2" х2"+1 


4.5.22 (р. 278) coshx = У; pj bec L Qn +1)! 


n=0 n=0 
4.5.23 (p. 278) (1 — x) 072.) x" = 1 converges for all x 


3 5 2 3 
4504 (p. BIRD (a) $950 27. os Beso (6) 


3 40 2 6 
x? x^  T721x6 3 


4 5 
co (dja un a ai 
2 24 7020 (ул = чы at 


2x? x х2 3x3 x? 
4.5.27 (p.279) (a) +x+G-+> + (b)i-x-—-—— +- (с) 1+5 + 
x? 7х4 31х° x^ xê 
ditt ee Se Se ee CLP шры, 
( ) T 6 T Wa ~ 15120 | (e) iid 12 360 | 
5 3 2 


(ü-—3)2x) 1-3x IF 


4.5.28 (p. 279) F(x) = = Sie _ yrs 
n=0 


4.5.29 (p. 279) 1 


Section 5.1 pp. 299—302 
5.1.1 (p. 299) (a) 6,0,3,3) (b) -.-14 (c) G 4.3.2 


6? 12’ 24° 36 
5.1.3 (p. 299) (a) 15 (b) 65/12 (c) J31 (d) V3 
5.14 (p. 299) (a) /89 (b) 166/12 (c)3 (d) J31 
5.1.5 (p. 299) (а) 12 (b) (с) 27 
5.1.7 (p. 299) X = Xo + tU (оо < t < оо) in all cases. 
5.1.8 (p. 299) ... U and X, — Xo are scalar multiples of V. 
5.19 (p. 299) (a) X = (1,—3, 4, 2) + t(1,3, —5,3) 
(b) X = @3,1,—2,1,4,)+г(=1,—1,1,3,—7) 
(c) X — (12, —1) +41,-3,0) 
5.1.10 (p. 300) (a) 5. (b)2 (с) 1/245 
5.1.11 (p. 300) (a) (1) {(х1, хо, xa. ха) | [xi] < 3 6 = 1, 2, 3) with at least one equality} 
(ii) (G3. x2, x3, ха) | || <3(@ =1,2,3)} (iii) S 
(iv) {(х1, хә, хз, ха) | |x;| > 3 for at least one of i = 1,2,3} 
(b) (i) S (ii) S (ii) (іу) {(х. у. z |z#1orx? +y > 1) 
5.1.12 (p. 300) (a) open (b) neither (c) closed 
5.1.18 (p. 300) (а) (л,1,0) (b) (1.0,e) 
5.1.19 (p. 300) (a)6 (b)6 (c)2/5 (4) 21/7 (е) оо 
5.129 (р. 302) {(х, y) |i 2- y? 2 1] 


5x4 
2 2 2 24 


61x$ 


720 
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5.1.33 (p. 302)... if for A there is an integer R such that |X,| > A ifr > R. 


Section 5.2 pp. 314—316 


5.2.1 (p. 314) (а) 10 (b)3 (c)! (d)O (e)o (f)o 

5.2.3 (p. 315) (b) a/(1 + a?) 

5.2.4 (p. 315) (а) оо (Б) оо (с) по (d)-oo (е) по 

5.2.5 (р. 315) (а) 0 (b)O (с) попе (4) 0 (е) попе 

5.2.6 (p. 316) (a) ...if Dy is unbounded and for each М there is ап R such that 
f(X) > M if X € D y and |X| > R. (b) Replace “> M" by “< M” in (a). 

5.2.7 (p. 316) limx>o f(X) = Oifa; +a2+::-+an > b; no limitifay+a2+-+:+an < 
b anda? +а2 +... +a? Æ 0; limx-59 f(X) = œ ifaı = ал =--- = an = Qand b > 0. 
5.2.8 (p. 316) No; for example, limx—>oo g(x, Vx) = 0. 

5.2.9 (p. 316) (a) R? (D) ? (c) КЗ (4) R? (е) {(х.у)|х> у) (f) Е" 
5.2.10 (p. 316) (a) R? — {(0,0,0)) (Þ) R? (c)R? (d)R? (e)R? 

5.2.11 (р. 316) f(x, y) = xy/(x? + y?) if (x, y) z (0,0) and f(0,0) = 0 


Section 5.3 pp. 335—339 


5.3.1 T 335) (a) Ae + y cos x — xy sin x) — NES cos x) (b) a 
(c) — 


ma + ++ xn) (9) 1/0 +x +y +z) 
5.3.2 (p. 335) ф2ф 5.3.3 (p. 335) (a) -5n//6 (b)—2e (c)O (d)o 
5.3.5 (p. 335) (a) fx = fy = 1/(х + y +22), Jz = 2/(х + y + 2z) 

(b) fx = 2x + 3yz + 2y, fy = 3xz + 2x, fe = 3xy (с) fr = e, fy = xze?*, 
fz = xye * (d) fx = 2хусозх?у, fy = x? cos x?y, fz = 1 

5.3.6 (p. 335) (a) хх = Љу = Љу = Љх = –1/(х + у + 22)2, Ља = fzx = 
Ле = fey = —2/(x +y + 2z), fez = —4/(x +y + 22) 

(b) Sux = 2, hry = Sez = 0, Ру = Љх = 34 + 2, Sez = Tex = Зу, fyz = Tey = 3x 
(c) Рх = 0, Љу = Ае Р = ху?е?*, Љу = fyx = ze", fez = fex = yer, 
fyz = fey = xe”? 

(d) хх = 2усозх?у — da^ y? sin x?y, fyy = =x* sinx? y, Ж, = 0, fxy = He = 
2х соз x y — 2х?узїпх?у, fa = fzx = fyz = Жу = 0 

5.37 (р. 336) (а) fsx(0,0) = fyy(0,0) = 0, fey (0,0) = —1, fyx(0,0) = 1 

(b) }хх(0,0) = fyy (0,0) = 0, fry (0, 0) = —1, fy (0,0) = 1 


5.3.8 (p. 336) f(x, y) = g(x, y) - h(y), where gx, exists everywhere and h is nowhere 
differentiable. 
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5.3.18 (p. 337) (a) df = (3x? +4y? - 2y sin x+2xy cos x) dx + (8xy -- 2x sin x) dy, 
dx, f = 16 dx, (dx, f )(X = Xo) = 16x 

(b) df = —е—*—>—© (dx + dy + dz), dx = —dx — dy — dz, 

(dxo f (X — Хо) = x —y—-z 

(c) df = (1 + xi + 2x2 ++ nx) 1 Vin J dxj, dxo f = Via j 4х), 
(dx, f (X — Xo) = 3524 jxj. 

(d) df = 2r|Xp77?» 7 x; dxj, dx, = 2rn" Уу аху, 

(dx, f )(X — Xo) = 2rn 1 75... (xj — 1), 

5.3.19 (p. 337) (b) The unit vector in the direction of ( f, (Хо), fx; (Xo). .... fx, (Xo)) 
provided that this is not 0; if it is 0, then 3f (Xo)/J® = 0 for every Ф. 

5.3.24 (p. 338) (a) = 22x -4y-6 (Б) = = 2х+3у+1 (с) z = (лх)/2+у-л/2 
(d) z 2 х + 10у + 4 


Section 5.4 рр. 356—360 


542 (p. 357) (а) 54и + 344) (Б) 0 (с) баи – 184 (4) 8аи 

5.4.3 (p. 357) л, = fx соѕ0 + fy sind, hg = r(— fx sind + fy соѕ 0), hz = fz 

5.44 (р. 357) л, = fy sin$ cos0 + fy ѕіпфѕіпе + f; cos ф, hg = r sin$(— fx sind + 

fy cos 0), hg = r(fx cos фсоѕ0 + fy cos sind — fz sing) 

5.4.6 (p. 357) hy = gxxy + gy + бошу, hz = gxXz + gz + £u Wz 

5.4.13 (p. 358) hy, = f. sin? ф cos? 0+ fyy sin? $ sin? 6+ / cos? H+ fry sin? ф sin20-- 
fyz sin2¢ sin 0 + fx sin2¢ cos 0, 

hro = (— fx зїп Ө + fy cos 0) sing + 5» — fex) sin? ф sin20 + rf, sin? ф cos 20 + 


5 (fey cos 0 = fzx sin 0) sin 2ф 


x2 y? x3 xy? 
5.4.16 (p. 358) (a) 1 Nod е 1. и 
(р аео е 

y? 3 х?у ху? y? 


2 
(b) 1-x-y+ > +y +5 -5-2-2 OLE 
(c)0 (d) xyz 
5.4.21 (p. 359) (a) (4% o PG. у) = (44 0), у) = 2(x — у)? 


Section 6.1 pp. 376—378 


3 46 : E 
613 (р. 376) (a) | 2 -4 2 | (Ы) [5 1 
7 23 $1 


12 16 28 44 -2 2 -6 


8 8 16 24 -2 -—6 0 
6.1.4 (р. 376) «| 0 0 4 Я o| 0 -2 “| 
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- 2 6 = 7 
6.1.5 (p. 376) (a) | 6 7 3 | (b) | з 5 | 
0 6 


13 25 


1.6 (p. 376) (a b) 2 
61.6 (p IE s | e$ 


25 
6.1.10 (p. 377) A and B are square of the same order. 


7 3 3 14 10 
6.112 (p. 377) Zr i 1 o| 6 | 
6 


76 4 -5 60 

6.1.13 (p. 377) | —9 7 13 |, 4 1 3 
5 0 -14 4 03 

3 


6.1.15 (p. 377) (a) | 6xyz 3xz? 3x?y || -6 
(b) cos(x+y)[ 1 1];[ 0 0] 

(с) [ (l—xz)ye* xe™ -x*ye?* ;[2 1 -2 | 
(d) sec?(x+2y+z)[ 1 2 1 ];[2 4 2] 

(e) IX! [х x2 Xn |; =I 
6.1.20 (p. 377) (a) (2,3,2) (b) (2,3,0) (c) 2,0,—1) (d) (3, 1,3,2) 


—1 1 2 
6.1.21 (p. 378) (а) 5 | E: |) ZH 3 1 Hd 


1 1; 1] 


-1 -1 2 
А 4 3 8 TEE 
(9) | 6-8 5 (5| -1 1 1 
-3 4 10 гї 

3 20 0 4 -2 0 5 

112 10 0 1 | —14 —18 10 20 

(е) = o 023 (Üzs| o1 22 -10 -25 

0 01 2 17 24 -10 -25 


Section 6.2 pp. 390—394 


2x 1 2 
6.2.12 (р. 392) (a) F(X) = | -sinx +y +z) -sinx +y +z) —sin@ +y + 2) 
yze?* xzexye хуеху 


ЈЕ(Х) = ех sin(x + y + z)x(1 — 2х)(у ^ z) – z(x — у)[; 
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2 1 3 х—1 
+| 00 o0 у +1 
0 0 -i z 


e*cosy —e*siny | ох, 
e*siny  e*cosy |’ EO ers 


| 
| 

sm -[1]«|1 РЕТ 
| 


0 
GX) = | 1 
1 


(b) Р(Х) = 


(с) F(X) = 


G(X) = | 


62.13 (p. 392) (a) FQ) = | 


—2х 0 2z 


—2 0 х—1 
2 —2 у—1 
0 2 &—1 


(x+y+z+ ех e* e* 
Qx—-x?— y?) 2ye* 0 


2x —2у 0 
0 2y —2z |; ЈЕ = 0; 


gi (x) 
82 (x) 
(b) F&®) =| °°, 
800) 
e*sinyz  ze*cosyz уе* соѕ уг 
(с) Е'(7, 0) 2 | ze"cosxz  e"sinxz хе? cosxz 
уе соѕху xe*cosxy e*sinxy 


6.2.14 (р. 392) (a) F'(r, Ө) = | cos рш | JF(r,9) = ғ 


sin 0 r cos 0 


(b) F'(r,0,ġ)= | sinócosó гсоѕ0 соѕф —r sinð sing 
sin $ 0 r cos à 
JF(r, 0,6) = r? соѕф 


соѕ Ө соф  —rsinO соѕф “ranean | 
> 


cos@ -—rsind 0 
(с) F(r,6,z) = | 5100 гсоѕ0 0 |; JF(r,6,z) =r 
0 0 1 


6.2.20 (p. 393) (a) | 8 E 6] ъ[ 5 J JE = | 


ОИЕ ДЕ "| 
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Section 6.3 pp. 414—417 


6.3.4 (p. 414) (a) [1,л/2] (b) [1,27] (с) 1, х] (d) [2V2,92/4] (е) 
[V2, 37/4] 

6.3.5 (p. 414) (a) [1,-3л/2] (b) 1, 2л] (с) П,—х] (d) 242, —7z/4] 
(e) [V2, —57/4] 

6.3.6 (p. 414) (b) Let f(x) = х (0 < x x 4), f(x) =х— 5 (5 «x < 1); then f is 
locally invertible but not invertible on [0, 1]. 

6.3.7 (p. 414) F(S) = {(и, v) | —z + 2ф < arg(u, v) < m + 26), where ф is an argu- 
ment of (a, b); 

cos(arg(u, v)/2) 


sin(arg(u, v)/2) 


1 = 1 Ж 
6.3.10 (р. 415) (а) | i |+ 5l Pd | Ee sl à | 


x 1 и + 20 + 3ш 1 1 2 3 
b E u — w & Œy =-| 1 0 -1 

y 

Z 2 u +v +2w 2 1 1 2 


6.3.12 (р. 415) Gi(u, v) = : b ] eie. »- 1 EE DE] 


Val Juv а -l/u-—v 


uosa] |: 2ф— л < arg(u, v) < 20 + x 


24/2 


Gatun) = | VEEP peo Tu em YE 
| /2 ио p ® 7 2/2 l//u—v -l/jfu-—v 

G3(u v= | C Lee е Ж | I/Ju+v ie 
| Jz КЕЛЕИ 9 2/2 | -M4w-v l/J/u-v 


С А | -Ju Fu | MEME | ууа INEF | 
Jara p 2/2 | —1/vu =v 1/ yu =v 

6.3.15 (p. 416) From solving x = r cos Ө, y = r sin 0 for Ө = arg(x, у). Each equation 

is satisfied by angles that are not arguments of (x, y), since none of the formulas identifies 

the quadrant of (x, y) uniquely. Moreover, (c) does not hold if x = 0. 


cos[2 arg(u, v)] 
sin(arg(u, v)/2) | 
where В — 1/2 < arg(u, v) < 8 + 2/2 and f is an argument of (a, b); 
1 х y 

/ E 
Со) = xci | —y x | 
6.3.19 (p. 416) If F(x1, x2, ..., Xn) = aĵ, ХЭ, КЕЕ x3), then F is invertible, but 
JF(0) =0. 


6.3.20 (p. 416) (a) aw) =| | ЕЕ ү 


6.3.16 (р. 416) | : | = Glu, v) = (02 + v2)! | 
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1 1 4 —2 u—2 
mammal i |r sls 73 [531 
0 0 -1 1 u—l 
(c)A(U) 2|] 1 | +] -1 1 0 v-1 
1 1 0 0 w-—2 
1 0 -1 0 u 
(d) А(О = | 2/2 |+|1 0 о v+1 
л 0 0 -l w 
cos 0 cos o sin Ө соѕф sing 
; _ sin Ө cos 0 0 
6.3.21 (p. 417) G'(x, y, z) = РОБ гове 
—- cos ѕіпф —-—sinÜsinó – соѕф 
r r r 
cos Ө sind 0 
6322 (p. 417) GG, y, = | —1 sing 100 0 
r r 
0 0 1 


Section 6.4 pp. 431—434 
u 1| -3 4 x 
641 (p. 431) (a) | à 1-5 edi] | 


ОНЕ ЕЦ Ble] 35] 


(d) u = =x, v = —y, Z = —w 


6.4.3 (р. 431) fi (X,U) = » aij (xj а) — (uj — шо), 1 < i < m, where r 
j=l 


and s are positive integers and not all aj; = 0. (a) r = = 3; (b) r = 1, s = 3; (c) 
r=s=2 

644 (р. 431) ux(1, 1) = —2, wy (1, 1) = –2 

6.4.5 (р. 431) и,(1,1,1) = $,и,(1,1,1) = -2;uz(, 1,1) = 1 
64.6 (p. 431) (а) u(1,2) = 0, ux(1,2) =и,(1,2) = —4 

(b) u(—1, —2) = 2, ux(—1, -2) = uy (-1, 2) = —4 

(c) u(x/2, 1/2) = ux (2/2, 1/2) = uy(x/2, 1/2) = 0 

(d) u(1,1) = 1, ux(1, 1) = uy(1,1) = -1 

ди1(1,1) —5 ди1(1,1) _ 


2 
дх | ду 


6.4.7 (р. 431) (a) и\(1,1) = 1, 
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du2(1, 1) Ы ГТ ди2(1, 1) = 


и2(1, 1) = 2, ax , ду =2 
(b) ик(0,л) = (2k + 1)л/2, 0л) = 0, DUELO —-], k = integer 
x y 


1 Z = 
6.4.8 (р. 432) =| Ж, = | | 6.4.9 (p. 432) w(0) = 3, v'(0) = —1 


(p x Е 
6.4.10 (p. 432) =] -5 -5 
6 6 


64.11 (p. 432) Ui(1, 1) = | | као = | E > 1 


vai.) =-| н ]va.»--[ E: d 


6.4.12 (p. 432) ux(0,0,0) = 2, vx(0, 0,0) = wx(0, 0,0) = —2 


д(/, g, h) д(/, g, h) 9(f, g, h) 
0(х, zZ, u) 0(v, z, u) 0(у, x,u) 
6.4.13 (p. 433) yx = “BF ey? = eD ЩДЕЮ` 
д(у, z, u) д(у, z, u) 0(у, z, u) 
д(/, g. h) д(7, g, А) д(/, g. h) 
z, = 20% 4) 2 30.2x) , _ 30.2. v) 
i (7, g h)' * If gh)’ ” Cf. g, h) 
9(y, z, u) 9(y, z, u) 9(y, z, u) 
6414 (p. 433) x = -2y — u, z = —2v; x = -2y — u, v = - E; y = - E - 4, 
X3) x 2 2 2 
Z ы: an E T аал ша? 


6.4.15 (p. 433) yx(1,—1,—2) 2 —4, v4(1,—1,—2) = 1 


6.4.16 (p. 433) uw (0, —1) = ž, uy (0, —1) = 0, vw (0, —1) = —2, vy (0, —1) = 0, 
хь(0,—1) = 1, xy(0,-1) = —1 


6.4.18 (р. 434) ux(1, 1) = 0, uy, 1) = 0, vx (1, 1) = —1, vy (1, 1) = —1, uxx (1,1) = 
ot: 1) = 1, uyy(1, 1) = 2, vex (1, 1) = —2, vy (L,.1 = 1, vy (1,1 = 2 

6.4.19 (p. 434) ux(1,-1) = 0, и, (1, 1) = а vx(1,—1) = - v, (1, -1) = 0, 
uxx(1, —1) = -5, uxy(1, 1) = =, uyy(1, 1) = E Uxx(1, —1) = -P 


8 
1 
Uxy (1, 1) = Er 0уу(1,=1) = = 


col — 


oo 
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Section 7.1 pp. 459—462 


712 (p. 459) (a) 28 (b) i 7.1.6 (p. 460) 3(b—a)(d—c),0 7.1.13 (p. 460) 


{(m, n) | m,n = integers) 


Section 7.2 pp. 480—484 
724 (р. 480) (а) 12 (b) 2 (c)-1 (d)(1-1og2)/2 


20 
7.2.5 (р. 481) (а) 2 (Ъ)17 (c)à(/2-1) (9) 1/47 
7.27 (р. 481) (а) 3,5 (b) 3,2 728 (р. 482) (а) 3,5 (b) 2 (2+1), 
Ikta) (exo 
7.211 (р. 482) (a) 22885. (Ь) 0 (с) 0 (4) 2(е– 5) 
7.2.12 (р. 483) (a) 324 (b) 1 (c)1 7243 (р. 483) 2 
7.214 (р. 483) (а) 36 (b)1 (с) 8% (9) (е + 17)/2 
7.2.17 (р. 483) (а) 2 (b)itee-2 (oZ (dz 
7248 (р. 483) (a) 16r (b) 1 (с) 128 (а) 2 
7.2.19 (p. 484) (a) $(b1 — ai): (bn — аһ) 37; (aj + bj) 
(b) i(bi — a1): (by — an) 27-114, +ajbj+ b?) 
(c) 2-"(b? — a?) --- (62 — a2) 
7.2.20 (p. 484) [^77 dx FAC у(х, у)ау 7222 (p. 484) 1 


Section 7.3 pp. 514—517 


7.3.1 (p. 514) Let Sı and S2 be dense subsets of R such that Sı U S2 = R. 

7.3.7 (p. 514) (a) —1; c (constant); 1 7.3.9 (p. 515) (их —ui)(v2 – 01) /а4 — bc| 
7.3.10 (p. 515) 7.3.14 (p. 515) (а) ý (b) 1065 7345 (p. 516) 3 
7.3.16 (p. 516) 1 7.3.37 (p. 516) 2e(e — 1) 

7.3.18 (p. 516) $zabc 7.3.19 (р. 516) 2z(e? —e?) 7.3.20 (p. 516) 16л/3 
7.3.21 (p. 516) 21/64 

7.3.22 (p. 516) (a) (x/8)1og5 (b) (x/4)(e* —1) (с) 2z/15 

7.323 (p. 517) x2a*/2 

7.3.24 (p. 517) (a) (f1—o1)--- (Bn—an)/|det(A)| 7.3.25 (p. 517) la1a2 --- as|Va 


Index 


A Binomial coefficient, 17 (Exercise 1.2.19), 
Abel’s test, 219 102, 194 (Exercise 4.1.35) 
Abel’s theorem, 273, 279 Binomial series, 266 
Absolute convergence, 215 Binomial theorem, 17 (Exercise 1.2.19) 

of an improper integral, 160 Bolzano—Weierstrass theorem, 27, 294, 

of a series of constants, 215 301 (Exercise 5.1.22) 

of a series of functions, 247 Bound 
Absolute integrability, 160 lower, 7 
Absolute uniform convergence, 247, 255 upper, 3 

(Exercises 4.4.17 and 4.4.20), Boundary, 526 
256 (Exercise 4.4.21) point, 289, 526 

of a power series, 257 of aset, 23, 289 
Absolute value, 2 Bounded convergence theorem, 243 
Addition of power series, 267 Bounded function, 47, 60, 313 
Adjoint matrix, 370 Boundedness of a continuous function 
Affine transformation, 380 on a closed interval, 62, 199 
Alternating series, 203 on a compact set, 313 

test, 203, 219 Boundedness of an integrable function, 
Analytic transformation, 416 (Exercise 6.3.17) 119 
Angle between two vectors, 286 on a metric space, 537 
Antiderivative, 143, 150 (Exercise 3.3.16) Bounded sequence, 181, 197, 292 
Archimedean property, 5 Bounded set 
Area under a curve, 116 above, 3, 313 
Argument, 398 below 7, 313 

branch of, 409, 410, 415 (Exercise 6.3.14) | Bounded variation, 134—135 (Exercises 3.2.7, 
Ascoli-Arzela theorem, 543 3.2.9, 3.2.10) 
Associative laws Branch 

for the real numbers, 2 (see p. 1) of an argument, 409, 415 

for vector addition, 283 of an inverse, 409 
B C 
Bessel function, 277 (Exercise 4.5.11) C[a,b], 521 


equicontinuous subset of, 541 
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uniformly bounded subset of, 541 
Cartesian product, 31, 435 
Cauchy product of series, 226, 233 (Ex- 
ercise 4.3.40), 280 (Exercise 4.5.32) 
Cauchy sequence, 527 
Cauchy’s convergence criterion 
for sequences of real numbers, 190 
for sequences of vectors, 292 
for series of real numbers, 204 
Cauchy’s root test, 215 
Cauchy’s uniform convergence criterion 
for sequences, 239 
for series, 246 
Chain rule, 77, 340, 388 
Change of variable, 145, 147 
in an improper integral, 164 
in a multiple integral, 496 
formulation of the rule for, 494 
in an ordinary integral, 145, 147 
Changing the order of integration, 478 
Characteristic function, 70 (Exercise 2.2.9), 
485 
Closed 
under scalar multiplication, 519 
under vector addition, 519 
Closed interval, 23 
Closed n-ball, 291 
Closed set, 21, 289, 525 
Closure of a set, 23, 289 
Cofactor, 370 
expanding a determinant in, 371—372 
Commutative laws 
for the reals, 2 (See p. 1) 
for vector addition, 283 
Compact set, 20, 293, 537 
Comparison test 
for improper integrals, 156 
for series, 206 
Complement of a set, 20 
Complete metric space, 527 
Completeness axiom, 4 
Complete ordered field, 4 
Component function, 311 
Components, 284 (see p. 281) 
of a vector-valued function, 311, 362 


Index 567 


Composite function, 58, 311 
continuity of, 59, 311 
differentiability of, 77, 340 
higher derivatives of, 345 
Taylor polynomial of, 109-110 
(Exercise 2.5.11) 
Composition of functions, 58 
Conditional convergence 
of an improper integral, 162 
of a series, 217 
Conditionally integrable, 162 
Connected metric space, 549 (Exercise 8.3.2) 
Connected set, 295 
polygonally, 296 
Containment of a set, 19 
Content, 453 
of a coordinate rectangle, 437 
of a set, 485 
zero, 448, 514 (Exercise refexer:7.3.2) 
Continuity, 54, 302 
of a composite function, 59, 311 
of a differentiable function, 76, 325 
of a function of п variables, 309 
of a function of one variable, 54 
on an interval, 55 
from the left, 54 
of a monotonic function, 67 
piecewise, 56 
from the right, 54 
on a set, 56, 311 
of a sum, difference, product, and 
quotient, 57, 311 
in terms of sequences, 198 
of a transformation, 379 
uniform, 64, 66, 314, 392 (Exercise 6.2.10) 
of a uniform limit, 242 
of auniformly convergent series, 250 
Continuous function 54, 309 
boundedness of, 62, 313 
extreme values of on a closed inter- 
val, 62 
integrability of, 133 
intermediate values of, 63, 313 
on a metric space, 545 
Continuous transformation, 379 
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Continuously differentiable, 73, 80, 329, 
385, 409 
Contraction mapping theorem, 547 
Convergence 
absolute 
of an improper integral, 160 
of a series of constants, 215 
absolute uniform, 247 
conditional 
of a series, 217 
of an improper integral, 162 
of an improper integral, 152 
of an infinite series, 201 
interval of, 258 
pointwise 
of a sequence of functions, 234, 
238 
of a series of functions, 244 
of a power series, 257 
radius of, 258 
of a sequence in a metric space, 526 
of a sequence in R”, 292 
of a sequence of real numbers, 179 
of a series of constants, 200 
of a sum, difference, or product of 
sequences, 184 
of a Taylor series, 264 
uniform, 246 
of a sequence, 237 
of a series, 246 
Coordinate cube, 437 
degenerate, 437 
nondegenerate, 437 
Coordinate rectangle, 437 
Coordinates, 
polar, 397, 502, 505 
spherical, 507 
Covering, open, 25, 293, 536 
Cramer’s rule, 373 
Critical point, 81, 335 
Curve, differentiable, 453 


D 
Decreasing sequence, 182 
Dedekind cut, 9 (Exercise 1.1.8) 


Dedekind’s theorem, 9 (Exercise 1.1.8) 
Defined inductively, 12 
Degree 


of a homogeneous polynomial, 352 
of a polynomial, 98 


Deleted e-neighborhood, 22 
Deleted neighborhood, 525 
Dense set, 6, 29 (Exercise 1.3.22), 70 (Ex- 


ercise 2.2.10) 


Density of the rationals, 6, 392 (Esercise 6.2.11) 
Density of the irrationals, 6 

Denumerable set, 176 

Derivative, 73 


of a composite function, 77 

directional, 317 

infinite, 88 (Exercise 2.3.26) 

of an inverse function, 86 (Exercise 2.3.14) 

left-hand, 79 

nth, 73 

one-sided, 79 

ordinary, 317 

partial, 317 

of a power series, 261—262 

right-hand, 79 

rth order, 319 

second, 73 

of a sum, difference, product, and 
quotient, 77 

zeroth, 73 


Determinant, 368 (see p. 369) 


expanding in cofactors, 371—372 
of a product of square matrices, 370 


Diameter of a set, 292, 586 
Difference quotient, 73 
Differentiability 


of a composite function, 340 
continuous, 329 

of a function of one variable, 73 

of a function of several variables, 323 
of the limit of a sequence, 243 

of a power series, 260—262 

of a series, 252 


Differentiable 73, 323 


continuously, 73, 80, 409 
curve, 453 


function, continuity of, 76, 325, 385 
on an interval, 80 
on а set, 73 
surface, 453 
transformation, 380 
vector-valued function, 339 
Differential, 326 
higher, 348 
of a linear transformation, 367 
matrix, 367, 381 
of a real-valued function, 326 
of a sum, difference, product, and 
quotient, 328 
of a transformation, 381 
Differential equation, 170—171 
(Exercises 3.4.27—3.4.29) 
Directional derivative, 317 
Dirichlet's test 
for improper integrals, 163 
for series of constants, 217 
for uniform convergence of series, 
248 
Disconnected set, 295 
Discontinuity 
jump, 56 
removable, 58 
Discrete metric, 519 
Disjoint sets, 20 
Distance 
in a metric space, 518 
from a point to a set, 301 
(Exercise 5.1.24) 
between subsets of a metric space, 
549 (Exercise 8.3.3) 
between two sets, 301 
(Exercise 5.1.25) 
between two vectors, 283 
Distributive law, 2 (see p. 1) 
Divergence, unconditional, 233 
(Exercise 4.3.38) 
Divergent improper integral, 152 
Divergent sequence, 179 
Divergent series, 201 
Domain of a function, 31 (see p. 30), 545 
Double integral, 438 
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E 

Edge lengths of a coordinate rectangle, 
437 

Elementary matrix, 488 

Empty set, 4 

Entries of a matrix, 364 

e-neighborhood, 21, 289, 525 

є-пеї, 539 

Equicontinuous subset of C [a, b], 541 

Equivalent metrics, 530 

Error in approximating derivatives, 112 
(Exercises 112-112) 

Euclidean n-space, 282 (see p. 281) 

Euler's constant, 230 (Exercise 4.3.14) 

Euler's theorem, 357—358 (Exercise 2.4.8) 

Existence of an improper integral, 152 

Existence theorem, 420 

Expanding a determinant, 362-372 

Exponential function, 70 (Exercise 2.2.12), 
72 (Exercise 2.2.33), 228, 273 

Extended mean value theorem, 106 

Extended reals, 7, 

Exterior point, 289, 526 

Exterior of a set, 23, 289, 526 


F 
Faa di Bruno's formula, 109 
(Exercise 2.5.11) 
Fibonnacci numbers, 17 (Exercise 1.2.17) 
Field 
complete ordered, 4 
ordered, 2 
properties, 2 (see p. 1) 
Finite real, 7 
First mean value theorem for integrals, 
139 
Forward differences, 104, 71 (Example 2.2.18), 
112 (Exercises 2.5.19—2.5.22) 
Fredholm's integral equation, 548 
Function 31, 32 
absolutely integrable, 160 
Bessel, 277 (Exercise 277) 
bounded, 47, 60, 313 
above, 60, 313 
below, 60, 313 
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of bounded variation, 134 (Exercise 3.2.7) 
characteristic, 70 (Exercise 2.2.9), 485 
composite, 58, 311 
decreasing, 44 
differentiable at a point, 73, 323 
domain of, 31, 32 
exponential, 70 (Exercise 2.2.12), 72 
(Exercise 2.2.33), 227, 273 
generating, 278 (Exercise 4.5.26) 
homogeneous, 357 (Exercise 5.4.8) 
increasing, 44 
infimum of, 55, 313 
inverse of, 68 
linear, 325 
locally integrable, 152 
maximum of, 60 
monotonic, 44, 67 
nondecreasing, 44 
nonincreasing, 44 
nonoscillatory at a point, 162 
nth power of, 33 
oscillation of, 171 
piecewise continuous, 56 
range of, 31, 32 
rational, 33, 232, (Exercise 4.3.28), 
276 (Exercise 4.5.4) 

real-valued, 302 
restriction of, 399 
Riemann integrable, 114, 438 
Riemann-Stieltjes integrable, 125 
strictly monotonic, 44 
supremum of, 313 
value of, 31, 32 
vector-valued, 311 

Functions, 
composition of, 58, 311 
difference of, 32 
product of, 32 
quotient of, 32 
sum of, 32 

Fundamental theorem of calculus, 143 


G 


Generalized mean value theorem, 83 


Generating function, 278 (Exercise 4.5.26) 
Geometric series, 202 
Grouping terms of series, 220 


H 

Heine-Borel property, 

Heine-Borel theorem, 172, 66, 172, 293 

Higher derivatives of a composite func- 
tion, 345 

Higher differential, 348 

Homogeneous function, 357 (Exercise 5.4.8), 
359 (Exercise 5.4.23) 

Homogeneous polynomial, 359 (Exercise 5.4.22), 

Homogeneous system, 375 

Hypercube, 295 (see p. 294) 

Hólder's inequality, 521 


I 
Identity matrix, 370 
Image, 394 
Implicit function theorem, 420, 423 
Improper integrability, 146 
Improper integral, 152 
absolutely convergent, 160 
change of variable in, 164 
conditionally convergent, 162 
convergence of, 152 
divergence of, 152 
existence of, 152 
of a nonnegative function, 156 
Incompleteness of the rationals, 6 
Increasing sequence, 182 
Indeterminate forms, 91, 93—95 
Induction assumption, 12 
Induction proof, 12 
Inequality, 
Hólder, 521 
Minkowski, 522 
Schwarz, 284 
triangle, 2, 285 
Infimum 
of a function, 60, 313 
of a set, 7 
existence and uniqueness of, 7, 9 
(Exercise 1.1.6) 


Infinite derivative, 88 (Exercise 2.3.26) 


Infinite limits, 42, 306, 317, 316(Exercise 5.2.6) 


Infinite sequence, 179 
in a metric space, 526 
Infinite series, 210, 244 
convergence of, 201 
integrability of, 251 
oscillatory, 201 
Infinity norm, 496, 523, 524 
Inner product, 284 
Instantaneous 
rate of change, 74 
velocity, 74 
Integrability 
conditional, 162 
of a continuous function, 133 
of a function of bounded variation, 
134 (Exercise 3.2.7) 
improper, 152 
of an infinite series, 251 
local, 152 
of a monotonic function, 133 
of a power series, 264 
Integrable 
Riemann, 114, 438 
Riemann-Stieltjes, 125 
Integral 
over an arbitrary set in R”, 452 
of a constant times a function, 136, 
456 
double, 439 
improper, 151 
iterated, 462 
lower 
for Riemann integral, 120, 442 
for Riemann-Stieltjes integral 128 
(Exercise 3.1.17) 
multiple, 439 
ordinary, 439 
of a product, 138, 456 
proper, 153 
over a rectangle in К”, 436 (See p. 435) 
Riemann, 114, 438 
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Riemann-Stieltjes, 125, 127 (Exer- 
cise 3.1.16), 135 (Exercises 3.2.8— 
3.2.10), 151 (Exercise 3.3.23) 
over subsets of IR", 436 (See p. 435), 
450, 452, 471—472 
of a sum, 136, 456 
test, 207 
triple, 439 
Integration by parts, 144 
for Riemann-Stieltjes integrals, 135 
(Exercise 3.2.8) 
Interior of a set, 21, 289 
Interior point, 21, 289, 525 
Intermediate value theorem 
for continuous functions, 63, 313 
for derivatives 82 
Intersection of sets, 20 
Interval 
closed, 23 
half closed, 23 
half open, 23 
open, 21 
semi-infinite, 21, 23 
Interval of convergence, 258 
for derivatives, 82 
Inverse function, 68 
branch of, 409 
derivative of, 86 (Exercise. 2.3.14) 
of a function restricted to a set, 399 
of a matrix, 370 
of a transformation, 396 
Inverse function theorem, 412 
Invertible, locally, 400 
Invertible transformation, 396 
Irrational number, 6 
Isolated point, 23, 289, 526 
Iterated integral, 462 
Iterated logarithm, 97 (Example 2.4.42), 
167 (Exercise 3.4.10), 208 230 


(Exercise 4.3.11), 230 (Exercise 4.3.16) 


J 
Jacobian, 384, 426 
Jordan content, 485 
changed by linear transformation, 488 
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Jordan measurable set, 485, 488 
Jump discontinuity, 56 


L 
Lebesgue measure zero, 175, 177 (Exer- 
cises 3.5.7, 3.5.8) 
Lebesgue’s existence criterion, 176 
Left limit inferior, 47 
Left limit superior, 47 
Left-hand derivative, 79 
Left-hand limit, 38 
Legendre polynomial, 278 (Exercise 4.5.27) 
Leibniz’s rule, 86, (Exercise. 2.3.12) 
Length of a vector, 283 
l'Hospital's rule, 88 
Limit of a real-valued function, 302 
Limit 
along a curve, 315 (Exercise 5.2.3) 
in the extended reals, 43 
inferior of a sequence, 188 
left, 47 
infinite, 42, 306, 316 (Exercise 5.2.6) 
at infinity, 307, 316 (Exercise 5.2.6) 
left-hand, 38 
one-sided, 37, 40 
point, 23, 289, 526 
pointwise, 234, 238, 244 
at +оо, 40 
of a real-valued function 
as x approaches xo, 34 
as x approaches oo, 40 
as x approaches —oo, 50 (Exer- 
cise 2.1.14) 
right-hand, 39 
of a sequence, 179, 292 
uniqueness of, 35, 305 
of a sum, product, or quotient, 35, 
305 
superior, left, 47 
superior of a sequence, 188 
uniform, 237 
uniqueness of, 35, 305 
Line segments in R", 288 
Line, parametric representation of, 288— 
289 


Linear function, 325 

Linear transformation, 362 
change of content under, 490 
differential of, 367 
matrix of, 363 

Lipschitz condition, 84, 87 (Exercise 2.3.24), 

140 

Local extreme point, 80, 334 

Local extreme value, 80 

Local integrability, 152 

Local maximum point, 80, 334 

Local minimum point, 80, 334 

Locally invertible, 400 

Lower bound, 7 

Lower integral, 120, 442 

Lower sum, 120, 442 


M 
Maclaurin's series, 264 
Magnitude, 2 
Main diagonal of a matrix, 370 
Mathematical induction, 10, 13 
Matrices 
product of, 364 
sum of, 364 
Matrix 
adjoint, 370 
of a composition of linear transfor- 
mations, 366 
differential, 367, 381 
elementary, 488 
identity, 370 
inverse, 370 
of a linear transformation, 363 
main diagonal of, 370 
nonsingular, 370 
norm of, 368 
scalar multiple of, 364 
singular, 370 
square, 368 (See p. 369) 
transpose of, 370 
Maximum value, local, 80 
Maximum of a function, 60 
Mean value theorem, 83, 347 
extended, 106 


generalized, 83 

for integrals, 138, 144 
Metric, 518 
discrete, 519 
induced by a norm, 520 
Metrics, equivalent, 530 
Metric space, 518 
complete, 527 
connected, 549 (Exercise 8.3.2) 
Minimum of a function, 60 
Minimum value, local, 80 
Minkowski’s inequality, 522 
Monotonic function, 44, 67, 84 
integrability of, 133 
Monotonic sequence, 182 
Multinomial coefficient, 322, 336 (Exer- 
cise 5.3.12) 
Multiple integral, 439 
Multiplication 

of matrices, 364 

of series, 223 

scalar, 519 
Multiplicity of a zero, 87 (Exercise. 2.3.21), 
108 (Exercises 2.5.5—2.5.7) 


N 
Natural numbers, 10 
n-ball, 290—291 
Negative definite polynomial, 353 
Negative semidefinite polynomial, 353 
Neighborhood, 21, 289, 525 
deleted, 22, 525 
deleted e, 22 
є, 21 
Nested sets, 292, 530 
principle of, 292, 530 
Nondecreasing sequence, 182 
Nondegenerate coordinate cube, 437 
Nondenumerable set, 176 
Nonempty set, 4 
Nonincreasing sequence, 182 
Nonoscillatory at a point, 162 
Nonsingular matrix, 370 
Nontrivial solution, 375 
Norm 
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infinity, 496, 523, 524 
of a matrix, 368 
metric induced by, 520 
of a partition, 114, 437 
on a vector space, 519 
Normed vector space, 519 
nth derivative, 73 
nth partial sum of a series, 201 
nth term of a series, 201 
Number, natural, 10 
Number, prime, 15 


O 
One-sided derivative, 79 
One-sided limit, 37 
One-to-one transformation, 396 
Open ball, 525 
Open covering, 25, 293, 536 
Open interval, 21 
Open n-ball, 290 
Open set, 21, 289, 525 
Ordered field, 2 
complete, 4 
Order relation, 2 
Ordinary derivative, 317 
Ordinary integral, 439 
Origin of R”, 283 
Oscillation of a function, 171 
at a point, 172 
Oscillatory infinite series, 201 


P 
Parametric representation of a line, 288, 
289 
Partial derivative, 317 
rth order, 319 
Partial sums, 244 
Partition, 114, 437 
norm of, 114, 437 
points, 114 
refinement of, 114, 438 
Path, polygonal, 296 
Peano’s postulates, 10-11 
Piecewise continuous function, 56 
Point, 19 
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boundary, 23, 289, 526 
critical, 81, 335 
exterior, 23, 289, 526 
at infinity, 7 
interior, 21, 289 
isolated, 23, 289, 526 
limit, 23, 289, 526 
local extreme, 80, 334 
local maximum, 80, 334 
local minimum, 80, 334 
in terms of sequences, 197 
Pointwise convergence 
of a sequence of functions, 234, 238 
of a series, 244 
Pointwise limit, 234, 238, 244 
Polar coordinates, 397, 502, 505 
Polygonal path, 296 
Polygonally connected, 296 
Polynomial, 33, 98 
homogeneous, 352 
negative definite, 353 
negative semidefinite, 353 
positive definite, 353 
positive semidefinite, 353 
semidefinite, 353 
Taylor, 99, 351 
Power series, 257 
arithmetic operations with, 267 
continuity of, 260—261 
convergence of, 257 
differentiability of, 260—261 
integration of, 264 
of a product, 268 
of a reciprocal, 271 
of a quotient, 269 
uniqueness of, 263 
Prime, 15 
Principal value, 155 
Principle of mathematical induction, 11, 
14 
Principle of nested sets, 530 
Product 
Cartesian, 31, 436 (see p. 435) 
Cauchy, 226, 233 (Example 4.3.40) 
inner, 284 


of matrices, 364 

of power series, 268 

of series, 223 
Proper integral, 153 


R 

IR", 282 (see p. 281) 

rth order partial derivative, 319 
Raabe's test, 212 

Radius of convergence, 258 
Range of a function, 31, 32, 545 
Ratio of a geometric series, 202 
Ratio test, 210 


Rational function, 33, 232 (Exercise 4.3.28), 


276 (Exercise 4.5.4) 
Rational numbers, 2 
density of, 6 
incompleteness of, 6 
Real line, 19 
Real number system, 19 
Real-valued function, 
of n variables, 302 
of a real variable, 31 
Reals, extended, 7 
Rearrangement of series, 221 
Rectangle, coordinate, 437 
Refinement of a partition, 114, 438 
Region, 295, 297 
Region of integration, 476 
Regular transformation, 405 
Remainder in Taylor's formula, 405 
Removable discontinuity, 58 
Restriction of a function, 399 
Riemann integrable, 114, 438 
Riemann integral 114 (see p. 113), 438 
uniqueness of, 125 (Exercise 3.1.1) 
Riemann sum, 114, 438 
Riemann-Stieltjes integral, 125 
integration by parts for, 135 (Exer- 
cise 3.2.8) 
Riemann-Stieltjes sum, 125 
Right limit inferior, 53 (Exercise 2.1.39) 
Right limit superior, 53 (Exercise 2.1.39) 
Right-hand derivative, 79 
Right-hand limit, 39 


Rolle’s theorem, 82 


S 
Scalar multiple, 282 
Scalar multiplication, 519 
Schwarz's inequality, 284 
Secant plane, 332-333 
Second derivative, 73 
Second derivative test, 103 
Second mean value theorem for integrals, 
144 
Sequence, 179, 526 
bounded, 181, 292 
bounded above, 181 
bounded below, 181 
Cauchy, 527 
convergence of, 179, 292, 526 
decreasing, 182 
divergent, 179 
to too, 181 
of functional values, 183 
of functions, 
pointwise, 234 
increasing, 182 
limit of, 179, 292 
uniform, 237 
limit inferior of, 188 
limit superior of, 188 
monotonic, 182 
nondecreasing, 182 
nonincreasing, 182 
nth term of, 179 
terms of, 179 
unbounded, 292 
uniformly convergent, 237 
Series 
alternating, 203 
binomial, 266 
Cauchy product of, 226, 233 (Exer- 


cise 4.3.40), 280 (Exercise 4.5.32) 


differentiability of, 252 
divergent, 201 
geometric, 202 
grouping terms in, 220 
Maclaurin, 264 


Set 


Sets 
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multiplication of, 223 

of nonnegative terms, 205 

partial sums of, 244 

power, 257 

product of, 218 

rearrangement of, 221 

Taylor, 223 

term by term differentiation of, 252 
term by term integration of, 251 
uniformly convergent, 246 


boundary of, 23, 289, 526 
bounded, 7, 537 
above, 3 
below, 7 

closed, 21, 289, 525 
closure of, 23, 289, 526 
compact, 26, 293, 537 
complement of, 20 
connected, 295 
containment of, 19 
content of, 485 
dense, 6, 29 (Example 1.3.22), 70 

(Exercise 2.2.10) 
denumerable, 176 
diameter of, 292, 537 
disconnected, 295 
empty, 4 
exterior of, 23, 289, 526 
interior of, 21, 289, 525 
nondenumerable, 176 
nonempty, 4 
open, 21, 289, 525 
singleton, 20 
strict containment of, 20 
subset of, 19 
totally bounded, 539 
unbounded below, 7 
uniformly bounded, 541 
universal, 19 


disjoint, 20 
equality of, 19 
intersection of, 20 
nested, 530 
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union of, 20 
Simple zero, 108 (Exercise 2.5.5) 
Singleton set, 20 
Singular matrix, 370 
Solution of a system of linear equations 
nontrivial, 375 
trivial, 375 
Space 
metric, 518 
vector, 519 
Spherical coordinates, 507 
Square matrix, 368 (see p. 369) 
Subsequence, 195 
of a convergent sequence, 196, 527 
Subset, 19 
Subspace of a vector space, 519 
Successor, 11 
Sum 
of matrices, 364 
Riemann, 114, 438 
lower, 120, 442 
upper, 120, 442 
Riemann-Stieltjes, 125 
of vectors, 282 
Summation by parts, 218 
Supremum 
of a function, 60, 313 
of a set, 3 
existence and uniqueness of, 4 
Surface, 331 
differentiable, 453 


T 

Tangent 
to a curve, 75 
line, 75 
plane, 332 


Taylor polynomial, 99, 351 
of a composite function, 109 (Exer- 
cise 2.5.11) 
of a product, 109 (Exercise 2.5.10) 
of a reciprocal, 110 (Exercise 2.5.12) 


for functions of n variables, 350 
for a function of one variable, 104 
Terms of a sequence, 179 
Term by term differentiation, 252 
Term by term integration, 251 
Test 
Cauchy's root, 215 
comparison 
for improper integrals, 156 
for series, 206 
integral, 207 
Raabe, 212 
ratio, 210 
second derivative, 103 
Topological properties of IR", 282 (See 
p. 281) 
Topological space, 26 
Total variation, 134 (Exercise 3.2.7) 
Totally bounded, 539 
Transformation, 362 
affine, 380 
analytic, 416 (Exercise 6.3.17) 
continuous, 379 
differentiable, 339, 379—380 
differential of, 381 
inverse of, 396 
invertible, 396396 
linear, 362 
one-to-one, 396 
regular, 405 
Transitivity of «, 31 
Transpose of a matrix, 370 
Triangle inequality, 2, 285 
in a metric space, 518 
Triple integral, 439 
Trivial solution, 375 


U 

Unbounded 
above, 7 
below, 7 


sequence, 292 


Taylor series, 264 
convergence of, 264 
Taylor's theorem 


Unconditional divergence, 233 (Exercise 4.3.38) 
Uniform continuity, 64, 72 (Exercises 2.2.30— 
2.2.32), 546 


for functions of variables, 314, 392 
(Exercise 6.2.10) 


Uniform convergence 


properties preserved by 
continuity, 242 
differentiability, 243 
integrability, 242 

of a sequence, 236 

of a series, 246 


Uniformly bounded set in C [a, b], 541 
Union of sets, 20 
Uniqueness 


= 
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of infimum, 7 

of limit, 35, 305, 527 

of power series, 263 

of prime factorization, 16 (Exercise 1.2.14) 
of Riemann integral, 125 (Exercise 3.1.1) 
of supremum, 4 


niform continuity, 64, 66, 72 (Exercises 2.2.30— 


2.2.32) 
nit vector, 283 
niversal set, 19 
pper bound, 3 
pper integral, 120, 442 
pper sum, 120, 442 


V 
Value 


of a function, 31, 32 
local maximum, 80 
local minimum, 80 

principal, 155 


Variation, total, 134 (Exercise 3.2.7) 
Vector, 283, 519 
Vector space, 283, 519 


normed, 519 
subspace of, 519 


Vector sum, 282 
Vector, unit, 283 
Vector-valued function, 362 (see p. 361) 


continuous, 379 
differentiable, 379—380 


W 
Weighted average, 139 
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Weierstrass’s test, 246 


Z 
Zero content, 448, 460 (Exercises 7.1.14, 
7.1.15), 461 (Exercises 7.1.16- 
7.1.19), 487, 514 (Exercise 7.3.2), 
515 (Exercise. 7.3.11) 
Zero 
multiplicity of, 108 (Exercises 2.5.5— 
251) 
simple 108 (Exercise 2.5.5) 
Zeroth derivative, 73 


